![[Jenkins]](/jenkins/static/b68c8964/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30092 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37261 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6686 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6692 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6687 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9257 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9128 originally caused by: Started by upstream project "master-libosmo-netif" build number 6968 originally caused by: Started by upstream project "master-libosmo-abis" build number 4961 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8961 originally caused by: Started by upstream project "master-osmo-mgw" build number 9193 originally caused by: Started by upstream project "master-libosmo-netif" build number 6968 originally caused by: Started by upstream project "master-libosmo-abis" build number 4961 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8716 originally caused by: Started by upstream project "master-osmo-hlr" build number 8851 originally caused by: Started by upstream project "master-libosmo-netif" build number 6968 originally caused by: Started by upstream project "master-libosmo-abis" build number 4961 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-bts" build number 7511 originally caused by: Started by upstream project "master-osmo-bts" build number 7575 originally caused by: Started by upstream project "master-libosmo-abis" build number 4961 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30093 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37262 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6687 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5538 originally caused by: Started by upstream project "master-osmo-bts" build number 7575 originally caused by: Started by upstream project "master-libosmo-abis" build number 4961 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8042 originally caused by: Started by upstream project "master-osmo-bts" build number 7575 originally caused by: Started by upstream project "master-libosmo-abis" build number 4961 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17682 originally caused by: Started by upstream project "master-osmo-bsc" build number 20144 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9128 originally caused by: Started by upstream project "master-libosmo-netif" build number 6968 originally caused by: Started by upstream project "master-libosmo-abis" build number 4961 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "master-osmo-mgw" build number 9193 originally caused by: Started by upstream project "master-libosmo-netif" build number 6968 Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29308 originally caused by: Started by upstream project "master-osmo-msc" build number 34270 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9128 originally caused by: Started by upstream project "master-libosmo-netif" build number 6968 originally caused by: Started by upstream project "master-libosmo-abis" build number 4961 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "master-osmo-mgw" build number 9193 originally caused by: Started by upstream project "master-libosmo-netif" build number 6968 Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30094 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37263 originally caused by: Started by upstream project "master-libosmo-netif" build number 6968 originally caused by: Started by upstream project "master-libosmo-abis" build number 4961 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "master-osmo-sgsn" build number 37264 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9128 originally caused by: Started by upstream project "master-libosmo-netif" build number 6968 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12992 originally caused by: Started by upstream project "master-openbsc" build number 13189 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9128 originally caused by: Started by upstream project "master-libosmo-netif" build number 6968 originally caused by: Started by upstream project "master-libosmo-abis" build number 4961 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4684 originally caused by: Started by upstream project "master-osmo-trx" build number 4893 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29309 originally caused by: Started by upstream project "master-osmo-msc" build number 34271 originally caused by: Started by upstream project "master-osmo-iuh" build number 12875 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9128 originally caused by: Started by upstream project "master-libosmo-netif" build number 6968 originally caused by: Started by upstream project "master-libosmo-abis" build number 4961 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30095 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37265 originally caused by: Started by upstream project "master-osmo-iuh" build number 12875 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9128 originally caused by: Started by upstream project "master-libosmo-netif" build number 6968 originally caused by: Started by upstream project "master-libosmo-abis" build number 4961 originally caused by: Started by upstream project "master-libosmocore" build number 3071 originally caused by: Started by an SCM change Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17682 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7511 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6692 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8716 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8961 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2989 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29309 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5155 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30095 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4684 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12992 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9257 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4712 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8042 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5194 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5538 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3911 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins86367389936646396.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-13 23:11:40 + trial_dir_prefix=trial- + rm -rf trial-2395 trial-2395-bin.tgz trial-2395-run.tgz + trial_dir=trial-2396 + mkdir -p trial-2396 + mv open5gs.build-8.tgz osmo-bsc.build-17682.tgz osmo-bts-oc2g.build-5538.tgz osmo-bts-sysmo.build-8042.tgz osmo-bts.build-7511.tgz osmo-ggsn.build-6692.tgz osmo-hlr.build-8716.tgz osmo-hnbgw.build-2989.tgz osmo-mgw.build-8961.tgz osmo-msc.build-29309.tgz osmo-nitb.build-12992.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30095.tgz osmo-stp.build-9257.tgz osmo-trx.build-4684.tgz osmocom-bb.build-4712.tgz srslte.build-19.tgz trial-2396 + cat open5gs.build-8.md5 osmo-bsc.build-17682.md5 osmo-bts-oc2g.build-5538.md5 osmo-bts-sysmo.build-8042.md5 osmo-bts.build-7511.md5 osmo-ggsn.build-6692.md5 osmo-hlr.build-8716.md5 osmo-hnbgw.build-2989.md5 osmo-mgw.build-8961.md5 osmo-msc.build-29309.md5 osmo-nitb.build-12992.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30095.md5 osmo-stp.build-9257.md5 osmo-trx.build-4684.md5 osmocom-bb.build-4712.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17682.md5 osmo-bts-oc2g.build-5538.md5 osmo-bts-sysmo.build-8042.md5 osmo-bts.build-7511.md5 osmo-ggsn.build-6692.md5 osmo-hlr.build-8716.md5 osmo-hnbgw.build-2989.md5 osmo-mgw.build-8961.md5 osmo-msc.build-29309.md5 osmo-nitb.build-12992.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30095.md5 osmo-stp.build-9257.md5 osmo-trx.build-4684.md5 osmocom-bb.build-4712.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2396 combinations: None trial: 'trial-2396' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2396 -------------------------------------------------------------------------------------------- 23:11:51.710943 tst trial-2396: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/log --------------------------------------------------------------------- trial-2396 nitb_sms:sysmo --------------------------------------------------------------------- 23:13:59.262596 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:13:59.266062 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 23:13:59.286645 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 23:13:59.293341 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 23:13:59.344928 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 23:13:59.366059 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 23:13:59.373213 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 23:13:59.911744 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 23:13:59.916576 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 23:13:59.927430 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 23:14:00.306334 tst mo_mt_sms.py: using LAC 36891 23:14:00.555580 tst mo_mt_sms.py: using RAC 171 23:14:00.672047 tst mo_mt_sms.py: using CellId 36891 23:14:00.789144 tst mo_mt_sms.py: using BVCI 36892 23:14:00.896066 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 23:14:01.097929 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 23:14:01.240802 tst mo_mt_sms.py:9: start nitb and bts... 23:14:01.468061 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:14:03.867606 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11898): Launched 23:14:04.192211 run osmo-nitb_10.42.42.2(pid=11899): Launched 23:14:04.369867 run osmo-nitb_10.42.42.2(pid=11899): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11899)] 23:14:04.503509 run osmo-nitb_10.42.42.2(pid=11899): stdout: | (launched: 2022-12-13_23:14:04.131824) 23:14:04.638558 run osmo-nitb_10.42.42.2(pid=11899): stderr: | (launched: 2022-12-13_23:14:04.179814) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:14:04.773573 run osmo-nitb_10.42.42.2(pid=11899): stdout: | (launched: 2022-12-13_23:14:04.131824) 23:14:04.902361 run osmo-nitb_10.42.42.2(pid=11899): stderr: | (launched: 2022-12-13_23:14:04.179814) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:14:05.056391 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=11899): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11899) [trial-2396↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11899)] [trial-2396↪nitb_sms:sysmo↪mo_mt_sms.py:11] 23:14:05.065373 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 23:14:05.072465 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11898): Terminating (SIGTERM) 23:14:05.283942 --- ParallelTerminationStrategy: PID 11898 died... 23:14:05.305772 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11898): Terminated: ok {rc=0} 23:14:05.397140 bus /sierra_3: Setting Powered False 23:14:06.498248 bus /sierra_3: Setting Powered False 23:14:07.620218 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 sms:sysmo --------------------------------------------------------------------- 23:14:08.805062 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:08.809507 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 23:14:08.830862 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 23:14:08.859143 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 23:14:08.913217 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 23:14:08.935054 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 23:14:08.962618 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 23:14:09.508340 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 sms:sysmo mo_mt_sms.py ---------------------------------------------- 23:14:09.514504 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:14:09.526154 tst sms:sysmo: Using 1 x bts (candidates: 1) 23:14:09.561064 tst mo_mt_sms.py: using LAC 36892 23:14:09.687824 tst mo_mt_sms.py: using RAC 172 23:14:09.813083 tst mo_mt_sms.py: using CellId 36892 23:14:09.940303 tst mo_mt_sms.py: using BVCI 36893 23:14:10.056686 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:14:10.067782 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:14:10.078761 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:14:10.089724 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:14:10.101079 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:14:10.112251 tst sms:sysmo: Using 1 x modem (candidates: 2) 23:14:10.233811 tst sms:sysmo: Using 1 x modem (candidates: 2) 23:14:10.353859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:12.072091 run create_hlr_db(pid=11903): Launched 23:14:12.198062 bus /sierra_2: Setting Powered False 23:14:13.258260 run create_hlr_db(pid=11903): Terminated: ok {rc=0} 23:14:13.703870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11905): Launched 23:14:14.029535 run osmo-hlr_10.42.42.2(pid=11906): Launched 23:14:14.152229 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:16.766188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11908): Launched 23:14:17.108054 run osmo-stp_10.42.42.5(pid=11909): Launched 23:14:17.270254 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:22.614305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11911): Launched 23:14:22.938045 run osmo-msc_10.42.42.6(pid=11912): Launched 23:14:23.117985 run osmo-stp_10.42.42.5(pid=11909): ERR: Terminated: ERROR {rc=1} [trial-2396↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11909)] 23:14:23.253835 run osmo-stp_10.42.42.5(pid=11909): stdout: | (launched: 2022-12-13_23:14:17.043338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:23.391376 run osmo-stp_10.42.42.5(pid=11909): stderr: | [0;m[38;5;43m20221213231417257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231417257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231417257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231417258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231417258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231417258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231417258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:23.527237 run osmo-stp_10.42.42.5(pid=11909): stdout: | (launched: 2022-12-13_23:14:17.043338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:23.655228 run osmo-stp_10.42.42.5(pid=11909): stderr: | [0;m[38;5;43m20221213231417257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231417257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231417257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231417258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231417258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231417258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231417258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:23.808892 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=11909): Process ended prematurely: osmo-stp_10.42.42.5(pid=11909) [trial-2396↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11909)] [trial-2396↪sms:sysmo↪mo_mt_sms.py:16] 23:14:23.817865 tst mo_mt_sms.py:16: Test FAILED (14.3 sec) 23:14:23.845233 run osmo-hlr_10.42.42.2(pid=11906): ERR: Terminated: ERROR {rc=237} [trial-2396↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11906)] 23:14:23.896450 run osmo-hlr_10.42.42.2(pid=11906): stdout: | (launched: 2022-12-13_23:14:13.968659) 23:14:23.949861 run osmo-hlr_10.42.42.2(pid=11906): stderr: | [0;m[1;31m20221213231414172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231414172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231414172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231414172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231414172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231414172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231414184 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231414194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231414194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231414194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:24.022791 run osmo-msc_10.42.42.6(pid=11912): ERR: Terminated: ERROR {rc=2} [trial-2396↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11912)] 23:14:24.073232 run osmo-msc_10.42.42.6(pid=11912): stdout: | (launched: 2022-12-13_23:14:22.877239) 23:14:24.125999 run osmo-msc_10.42.42.6(pid=11912): stderr: | [0;m[38;5;43m20221213231423204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231423204 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5bb05a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231423204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231423204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231423204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231423205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231423206 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231423207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231423207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231423207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:24.178738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11905): Terminating (SIGTERM) 23:14:24.220896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11908): Terminating (SIGTERM) 23:14:24.263406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11911): Terminating (SIGTERM) 23:14:24.306386 --- ParallelTerminationStrategy: PID 11905 died... 23:14:24.326893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11905): Terminated: ok {rc=0} 23:14:24.374650 --- ParallelTerminationStrategy: PID 11908 died... 23:14:24.394845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11908): Terminated: ok {rc=0} 23:14:24.441808 --- ParallelTerminationStrategy: PID 11911 died... 23:14:24.461959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11911): Terminated: ok {rc=0} 23:14:24.550469 bus /sierra_3: Setting Powered False 23:14:25.651194 bus /sierra_3: Setting Powered False 23:14:26.770622 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_ussd:sysmo --------------------------------------------------------------------- 23:14:27.990327 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:27.994349 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 23:14:28.015040 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 23:14:28.021782 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 23:14:28.055536 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 23:14:28.076610 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 23:14:28.083312 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 23:14:28.604238 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2396 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 23:14:28.609243 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 23:14:28.619807 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 23:14:28.653077 tst assert_extension.py: using LAC 36893 23:14:28.780357 tst assert_extension.py: using RAC 173 23:14:28.905272 tst assert_extension.py: using CellId 36893 23:14:29.030089 tst assert_extension.py: using BVCI 36894 23:14:29.149257 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 23:14:29.264670 tst assert_extension.py:10: start nitb and bts... 23:14:29.467167 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:14:30.084010 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11917): Launched 23:14:30.387530 run osmo-nitb_10.42.42.2(pid=11918): Launched 23:14:30.553696 run osmo-nitb_10.42.42.2(pid=11918): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11918)] 23:14:30.688606 run osmo-nitb_10.42.42.2(pid=11918): stdout: | (launched: 2022-12-13_23:14:30.330352) 23:14:30.825173 run osmo-nitb_10.42.42.2(pid=11918): stderr: | (launched: 2022-12-13_23:14:30.375085) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:14:30.986466 run osmo-nitb_10.42.42.2(pid=11918): stdout: | (launched: 2022-12-13_23:14:30.330352) 23:14:31.131574 run osmo-nitb_10.42.42.2(pid=11918): stderr: | (launched: 2022-12-13_23:14:30.375085) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11918): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11918) [trial-2396↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11918)] 23:14:31.501014 tst osmo-nitb_10.42.42.2(pid=11918): stdout: | (launched: 2022-12-13_23:14:30.330352) 23:14:31.623862 tst osmo-nitb_10.42.42.2(pid=11918): stderr: | (launched: 2022-12-13_23:14:30.375085) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:14:31.771924 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=11918): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11918) [trial-2396↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11918)] [trial-2396↪nitb_ussd:sysmo↪assert_extension.py:12] 23:14:31.781025 tst assert_extension.py:12: Test FAILED (3.2 sec) 23:14:31.788557 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11917): Terminating (SIGTERM) 23:14:31.999353 --- ParallelTerminationStrategy: PID 11917 died... 23:14:32.022594 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11917): Terminated: ok {rc=0} 23:14:32.129229 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 ussd:sysmo --------------------------------------------------------------------- 23:14:33.299759 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:33.304054 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 23:14:33.325405 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 23:14:33.352566 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 23:14:33.390797 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 23:14:33.413632 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 23:14:33.441943 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 23:14:33.963414 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2396 ussd:sysmo assert_extension.py ---------------------------------------------- 23:14:33.969444 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:33.980508 tst ussd:sysmo: Using 1 x bts (candidates: 1) 23:14:34.016071 tst assert_extension.py: using LAC 36894 23:14:34.145170 tst assert_extension.py: using RAC 174 23:14:34.265373 tst assert_extension.py: using CellId 36894 23:14:34.385126 tst assert_extension.py: using BVCI 36895 23:14:34.495544 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:34.506246 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:34.516723 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:34.527191 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:34.537582 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:34.547901 tst ussd:sysmo: Using 1 x modem (candidates: 1) 23:14:34.667109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:35.172441 run create_hlr_db(pid=11924): Launched 23:14:35.299280 bus /sierra_2: Setting Powered False 23:14:36.363410 run create_hlr_db(pid=11924): Terminated: ok {rc=0} 23:14:36.798553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11926): Launched 23:14:37.101870 run osmo-hlr_10.42.42.2(pid=11927): Launched 23:14:37.216820 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:37.740783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11929): Launched 23:14:38.044895 run osmo-stp_10.42.42.5(pid=11930): Launched 23:14:38.160228 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:38.706660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11932): Launched 23:14:39.008511 run osmo-msc_10.42.42.6(pid=11933): Launched 23:14:39.176742 run osmo-stp_10.42.42.5(pid=11930): ERR: Terminated: ERROR {rc=1} [trial-2396↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11930)] 23:14:39.305234 run osmo-stp_10.42.42.5(pid=11930): stdout: | (launched: 2022-12-13_23:14:37.987211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:39.433145 run osmo-stp_10.42.42.5(pid=11930): stderr: | [0;m[38;5;43m20221213231438163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231438163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231438163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231438164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231438164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231438164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231438165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:39.559163 run osmo-stp_10.42.42.5(pid=11930): stdout: | (launched: 2022-12-13_23:14:37.987211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:39.679071 run osmo-stp_10.42.42.5(pid=11930): stderr: | [0;m[38;5;43m20221213231438163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231438163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231438163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231438164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231438164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231438164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231438165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:39.822822 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=11930): Process ended prematurely: osmo-stp_10.42.42.5(pid=11930) [trial-2396↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11930)] [trial-2396↪ussd:sysmo↪assert_extension.py:17] 23:14:39.830958 tst assert_extension.py:17: Test FAILED (5.9 sec) 23:14:39.856699 run osmo-hlr_10.42.42.2(pid=11927): ERR: Terminated: ERROR {rc=237} [trial-2396↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11927)] 23:14:39.904309 run osmo-hlr_10.42.42.2(pid=11927): stdout: | (launched: 2022-12-13_23:14:37.044329) 23:14:39.953843 run osmo-hlr_10.42.42.2(pid=11927): stderr: | [0;m[1;31m20221213231437224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231437224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231437224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231437224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231437224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231437224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231437239 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231437250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231437250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231437250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:40.022932 run osmo-msc_10.42.42.6(pid=11933): ERR: Terminated: ERROR {rc=2} [trial-2396↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11933)] 23:14:40.071604 run osmo-msc_10.42.42.6(pid=11933): stdout: | (launched: 2022-12-13_23:14:38.951291) 23:14:40.121201 run osmo-msc_10.42.42.6(pid=11933): stderr: | [0;m[38;5;43m20221213231439224 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231439224 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6133b15c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231439224 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231439224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231439224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231439225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231439226 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231439227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231439227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231439227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:40.171040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11926): Terminating (SIGTERM) 23:14:40.211072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11929): Terminating (SIGTERM) 23:14:40.250986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11932): Terminating (SIGTERM) 23:14:40.291061 --- ParallelTerminationStrategy: PID 11926 died... 23:14:40.310361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11926): Terminated: ok {rc=0} 23:14:40.354480 --- ParallelTerminationStrategy: PID 11929 died... 23:14:40.373203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11929): Terminated: ok {rc=0} 23:14:40.417130 --- ParallelTerminationStrategy: PID 11932 died... 23:14:40.435654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11932): Terminated: ok {rc=0} 23:14:40.519256 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:14:41.711276 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:41.717617 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:14:41.738274 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:14:41.764769 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:14:41.817105 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:14:41.838922 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:14:41.866614 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:14:42.415127 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:14:42.467248 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:42.478464 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:14:42.535374 tst mo_mt_call.py: using LAC 36895 23:14:42.658945 tst mo_mt_call.py: using RAC 175 23:14:42.789437 tst mo_mt_call.py: using CellId 36895 23:14:42.910969 tst mo_mt_call.py: using BVCI 36896 23:14:43.023340 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:43.034558 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:43.045571 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:43.056447 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:43.067900 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:43.078851 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:14:43.202028 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:14:43.324712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:43.803735 run create_hlr_db(pid=11938): Launched 23:14:43.929476 bus /sierra_2: Setting Powered False 23:14:44.990752 run create_hlr_db(pid=11938): Terminated: ok {rc=0} 23:14:45.446676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11940): Launched 23:14:45.779115 run osmo-hlr_10.42.42.2(pid=11941): Launched 23:14:45.984294 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:46.653878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11943): Launched 23:14:46.996274 run osmo-stp_10.42.42.5(pid=11944): Launched 23:14:47.237912 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:47.836133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11946): Launched 23:14:48.168541 run osmo-msc_10.42.42.6(pid=11947): Launched 23:14:48.352341 run osmo-stp_10.42.42.5(pid=11944): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11944)] 23:14:48.490982 run osmo-stp_10.42.42.5(pid=11944): stdout: | (launched: 2022-12-13_23:14:46.931719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:48.630377 run osmo-stp_10.42.42.5(pid=11944): stderr: | [0;m[38;5;43m20221213231447236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231447236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231447236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231447237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231447237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231447237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231447237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:48.768721 run osmo-stp_10.42.42.5(pid=11944): stdout: | (launched: 2022-12-13_23:14:46.931719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:48.899244 run osmo-stp_10.42.42.5(pid=11944): stderr: | [0;m[38;5;43m20221213231447236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231447236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231447236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231447237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231447237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231447237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231447237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:49.056002 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11944): Process ended prematurely: osmo-stp_10.42.42.5(pid=11944) [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11944)] [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:14:49.065481 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 23:14:49.093150 run osmo-hlr_10.42.42.2(pid=11941): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11941)] 23:14:49.143893 run osmo-hlr_10.42.42.2(pid=11941): stdout: | (launched: 2022-12-13_23:14:45.717465) 23:14:49.196704 run osmo-hlr_10.42.42.2(pid=11941): stderr: | [0;m[1;31m20221213231445997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231445997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231445997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231445997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231445997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231445997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231446008 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231446017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231446029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231446029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:49.269157 run osmo-msc_10.42.42.6(pid=11947): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11947)] 23:14:49.319189 run osmo-msc_10.42.42.6(pid=11947): stdout: | (launched: 2022-12-13_23:14:48.105695) 23:14:49.371126 run osmo-msc_10.42.42.6(pid=11947): stderr: | [0;m[38;5;43m20221213231448432 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231448432 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd949cf6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231448432 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231448432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231448432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231448432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231448434 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231448434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231448435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231448435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:49.423257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11940): Terminating (SIGTERM) 23:14:49.465576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11943): Terminating (SIGTERM) 23:14:49.507575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11946): Terminating (SIGTERM) 23:14:49.550555 --- ParallelTerminationStrategy: PID 11940 died... 23:14:49.571264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11940): Terminated: ok {rc=0} 23:14:49.617811 --- ParallelTerminationStrategy: PID 11943 died... 23:14:49.637455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11943): Terminated: ok {rc=0} 23:14:49.683647 --- ParallelTerminationStrategy: PID 11946 died... 23:14:49.703738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11946): Terminated: ok {rc=0} 23:14:49.792510 bus /sierra_3: Setting Powered False 23:14:50.891369 bus /sierra_3: Setting Powered False 23:14:52.007832 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:14:53.158694 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:53.171101 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:14:53.237747 tst mo_mt_call_osmux.py: using LAC 36896 23:14:53.389305 tst mo_mt_call_osmux.py: using RAC 176 23:14:53.535164 tst mo_mt_call_osmux.py: using CellId 36896 23:14:53.656773 tst mo_mt_call_osmux.py: using BVCI 36897 23:14:53.778771 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:53.790577 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:53.802333 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:53.813938 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:53.825877 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:53.837860 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:14:53.956201 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:14:54.078694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:54.594489 run create_hlr_db(pid=11949): Launched 23:14:54.720926 bus /sierra_2: Setting Powered False 23:14:55.785992 run create_hlr_db(pid=11949): Terminated: ok {rc=0} 23:14:56.245646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11951): Launched 23:14:56.556151 run osmo-hlr_10.42.42.2(pid=11952): Launched 23:14:56.674154 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:57.224296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11954): Launched 23:14:57.534093 run osmo-stp_10.42.42.5(pid=11955): Launched 23:14:57.651037 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:58.209006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11957): Launched 23:14:58.519102 run osmo-msc_10.42.42.6(pid=11958): Launched 23:14:58.690744 run osmo-stp_10.42.42.5(pid=11955): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11955)] 23:14:58.821109 run osmo-stp_10.42.42.5(pid=11955): stdout: | (launched: 2022-12-13_23:14:57.475761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:58.950760 run osmo-stp_10.42.42.5(pid=11955): stderr: | [0;m[38;5;43m20221213231457650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231457650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231457651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231457651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231457651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231457651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231457652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:59.078450 run osmo-stp_10.42.42.5(pid=11955): stdout: | (launched: 2022-12-13_23:14:57.475761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:59.200539 run osmo-stp_10.42.42.5(pid=11955): stderr: | [0;m[38;5;43m20221213231457650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231457650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231457651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231457651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231457651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231457651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231457652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:59.347217 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11955): Process ended prematurely: osmo-stp_10.42.42.5(pid=11955) [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11955)] [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:14:59.356034 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:14:59.382197 run osmo-hlr_10.42.42.2(pid=11952): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11952)] 23:14:59.430602 run osmo-hlr_10.42.42.2(pid=11952): stdout: | (launched: 2022-12-13_23:14:56.497411) 23:14:59.479945 run osmo-hlr_10.42.42.2(pid=11952): stderr: | [0;m[1;31m20221213231456678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231456678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231456678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231456678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231456678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231456678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231456691 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231456702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231456702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231456702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:59.548833 run osmo-msc_10.42.42.6(pid=11958): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11958)] 23:14:59.596557 run osmo-msc_10.42.42.6(pid=11958): stdout: | (launched: 2022-12-13_23:14:58.460286) 23:14:59.646095 run osmo-msc_10.42.42.6(pid=11958): stderr: | [0;m[38;5;43m20221213231458737 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231458737 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3250f1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231458737 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231458737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231458737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231458738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231458739 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231458740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231458740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231458740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:59.695713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11951): Terminating (SIGTERM) 23:14:59.735241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11954): Terminating (SIGTERM) 23:14:59.774979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11957): Terminating (SIGTERM) 23:14:59.815001 --- ParallelTerminationStrategy: PID 11951 died... 23:14:59.834242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11951): Terminated: ok {rc=0} 23:14:59.877909 --- ParallelTerminationStrategy: PID 11954 died... 23:14:59.896514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11954): Terminated: ok {rc=0} 23:14:59.940195 --- ParallelTerminationStrategy: PID 11957 died... 23:14:59.958695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11957): Terminated: ok {rc=0} 23:15:00.044123 bus /sierra_3: Setting Powered False 23:15:01.146219 bus /sierra_3: Setting Powered False 23:15:02.266644 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:15:03.504676 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:15:03.511766 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:15:03.533324 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:15:03.561862 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:15:03.615947 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:15:03.638761 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:15:03.666740 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:15:04.217624 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:15:04.268394 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:04.279684 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:15:04.336816 tst mo_mt_call.py: using LAC 36897 23:15:04.458249 tst mo_mt_call.py: using RAC 177 23:15:04.581099 tst mo_mt_call.py: using CellId 36897 23:15:04.704085 tst mo_mt_call.py: using BVCI 36898 23:15:04.817057 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:04.828095 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:04.838949 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:04.849787 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:04.860633 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:04.871594 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:15:04.991986 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:15:05.109590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:05.590596 run create_hlr_db(pid=11966): Launched 23:15:05.716291 bus /sierra_2: Setting Powered False 23:15:06.778015 run create_hlr_db(pid=11966): Terminated: ok {rc=0} 23:15:07.230670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11968): Launched 23:15:07.545621 run osmo-hlr_10.42.42.2(pid=11969): Launched 23:15:07.663272 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:08.212500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11971): Launched 23:15:08.523209 run osmo-stp_10.42.42.5(pid=11972): Launched 23:15:08.640172 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:09.198689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11974): Launched 23:15:09.509413 run osmo-msc_10.42.42.6(pid=11975): Launched 23:15:09.682577 run osmo-stp_10.42.42.5(pid=11972): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11972)] 23:15:09.812589 run osmo-stp_10.42.42.5(pid=11972): stdout: | (launched: 2022-12-13_23:15:08.464637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:09.943319 run osmo-stp_10.42.42.5(pid=11972): stderr: | [0;m[38;5;43m20221213231508638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231508638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231508639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231508639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231508640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231508640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231508640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:10.071266 run osmo-stp_10.42.42.5(pid=11972): stdout: | (launched: 2022-12-13_23:15:08.464637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:10.193717 run osmo-stp_10.42.42.5(pid=11972): stderr: | [0;m[38;5;43m20221213231508638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231508638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231508639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231508639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231508640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231508640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231508640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:10.341244 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11972): Process ended prematurely: osmo-stp_10.42.42.5(pid=11972) [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11972)] [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:15:10.350000 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:15:10.376275 run osmo-hlr_10.42.42.2(pid=11969): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11969)] 23:15:10.425074 run osmo-hlr_10.42.42.2(pid=11969): stdout: | (launched: 2022-12-13_23:15:07.486746) 23:15:10.474672 run osmo-hlr_10.42.42.2(pid=11969): stderr: | [0;m[1;31m20221213231507668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231507668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231507669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231507669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231507669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231507669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231507681 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231507690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231507690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231507690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:10.543706 run osmo-msc_10.42.42.6(pid=11975): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11975)] 23:15:10.591331 run osmo-msc_10.42.42.6(pid=11975): stdout: | (launched: 2022-12-13_23:15:09.450436) 23:15:10.640548 run osmo-msc_10.42.42.6(pid=11975): stderr: | [0;m[38;5;43m20221213231509724 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231509725 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5728c03c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231509725 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231509725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231509725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231509725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231509727 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231509727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231509727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231509727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:10.689907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11968): Terminating (SIGTERM) 23:15:10.729256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11971): Terminating (SIGTERM) 23:15:10.768616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11974): Terminating (SIGTERM) 23:15:10.808163 --- ParallelTerminationStrategy: PID 11968 died... 23:15:10.827215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11968): Terminated: ok {rc=0} 23:15:10.870864 --- ParallelTerminationStrategy: PID 11971 died... 23:15:10.889342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11971): Terminated: ok {rc=0} 23:15:10.933282 --- ParallelTerminationStrategy: PID 11974 died... 23:15:10.951724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11974): Terminated: ok {rc=0} 23:15:11.038549 bus /sierra_3: Setting Powered False 23:15:12.139177 bus /sierra_3: Setting Powered False 23:15:13.254725 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:15:14.402094 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:14.413872 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:15:14.471367 tst mo_mt_call_osmux.py: using LAC 36898 23:15:14.600137 tst mo_mt_call_osmux.py: using RAC 178 23:15:14.728652 tst mo_mt_call_osmux.py: using CellId 36898 23:15:14.858810 tst mo_mt_call_osmux.py: using BVCI 36899 23:15:14.970819 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:14.982078 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:14.993049 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:15.003913 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:15.014866 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:15.025903 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:15:15.140354 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:15:15.262742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:15.778582 run create_hlr_db(pid=11977): Launched 23:15:15.940232 bus /sierra_2: Setting Powered False 23:15:17.004586 run create_hlr_db(pid=11977): Terminated: ok {rc=0} 23:15:17.447237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11979): Launched 23:15:17.758868 run osmo-hlr_10.42.42.2(pid=11980): Launched 23:15:17.877083 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:18.410259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11982): Launched 23:15:18.719346 run osmo-stp_10.42.42.5(pid=11983): Launched 23:15:18.836637 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:19.395275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11985): Launched 23:15:19.705070 run osmo-msc_10.42.42.6(pid=11986): Launched 23:15:19.877339 run osmo-stp_10.42.42.5(pid=11983): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11983)] 23:15:20.006968 run osmo-stp_10.42.42.5(pid=11983): stdout: | (launched: 2022-12-13_23:15:18.660830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:20.137115 run osmo-stp_10.42.42.5(pid=11983): stderr: | [0;m[38;5;43m20221213231518832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231518832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231518832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231518833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231518835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231518835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231518835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:20.265352 run osmo-stp_10.42.42.5(pid=11983): stdout: | (launched: 2022-12-13_23:15:18.660830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:20.388163 run osmo-stp_10.42.42.5(pid=11983): stderr: | [0;m[38;5;43m20221213231518832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231518832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231518832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231518833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231518835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231518835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231518835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:20.535067 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11983): Process ended prematurely: osmo-stp_10.42.42.5(pid=11983) [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11983)] [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:15:20.543809 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:15:20.570122 run osmo-hlr_10.42.42.2(pid=11980): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11980)] 23:15:20.618130 run osmo-hlr_10.42.42.2(pid=11980): stdout: | (launched: 2022-12-13_23:15:17.700168) 23:15:20.667516 run osmo-hlr_10.42.42.2(pid=11980): stderr: | [0;m[1;31m20221213231517880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231517880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231517880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231517880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231517880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231517880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231517905 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231517914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231517914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231517914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:20.736091 run osmo-msc_10.42.42.6(pid=11986): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11986)] 23:15:20.783620 run osmo-msc_10.42.42.6(pid=11986): stdout: | (launched: 2022-12-13_23:15:19.646502) 23:15:20.833177 run osmo-msc_10.42.42.6(pid=11986): stderr: | [0;m[38;5;43m20221213231519919 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231519919 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f06aa707c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231519919 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231519919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231519920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231519920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231519922 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231519922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231519922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231519922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:20.882723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11979): Terminating (SIGTERM) 23:15:20.922053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11982): Terminating (SIGTERM) 23:15:20.961392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11985): Terminating (SIGTERM) 23:15:21.000837 --- ParallelTerminationStrategy: PID 11979 died... 23:15:21.019944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11979): Terminated: ok {rc=0} 23:15:21.063797 --- ParallelTerminationStrategy: PID 11982 died... 23:15:21.082376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11982): Terminated: ok {rc=0} 23:15:21.125996 --- ParallelTerminationStrategy: PID 11985 died... 23:15:21.144783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11985): Terminated: ok {rc=0} 23:15:21.228426 bus /sierra_3: Setting Powered False 23:15:22.326264 bus /sierra_3: Setting Powered False 23:15:23.444118 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:15:24.682691 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:15:24.689691 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:15:24.711283 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:15:24.739566 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:15:24.793978 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:15:24.815610 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:15:24.843170 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:15:25.391753 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:15:25.441433 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:25.452640 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:15:25.509576 tst mo_mt_call.py: using LAC 36899 23:15:25.632245 tst mo_mt_call.py: using RAC 179 23:15:25.753588 tst mo_mt_call.py: using CellId 36899 23:15:25.884934 tst mo_mt_call.py: using BVCI 36900 23:15:26.006908 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:26.018778 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:26.030408 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:26.041994 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:26.053953 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:26.065838 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:15:26.184149 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:15:26.305874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:26.821338 run create_hlr_db(pid=11992): Launched 23:15:26.946337 bus /sierra_2: Setting Powered False 23:15:28.011009 run create_hlr_db(pid=11992): Terminated: ok {rc=0} 23:15:28.454806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11994): Launched 23:15:28.765899 run osmo-hlr_10.42.42.2(pid=11995): Launched 23:15:28.883691 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:29.415881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11997): Launched 23:15:29.725390 run osmo-stp_10.42.42.5(pid=11998): Launched 23:15:29.842780 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:30.400921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12000): Launched 23:15:30.712475 run osmo-msc_10.42.42.6(pid=12001): Launched 23:15:30.949494 run osmo-stp_10.42.42.5(pid=11998): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11998)] 23:15:31.237410 run osmo-stp_10.42.42.5(pid=11998): stdout: | (launched: 2022-12-13_23:15:29.666725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:31.492338 run osmo-stp_10.42.42.5(pid=11998): stderr: | [0;m[38;5;43m20221213231529839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231529839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231529839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231529840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231529840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231529840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231529840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:31.635682 run osmo-stp_10.42.42.5(pid=11998): stdout: | (launched: 2022-12-13_23:15:29.666725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:31.774510 run osmo-stp_10.42.42.5(pid=11998): stderr: | [0;m[38;5;43m20221213231529839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231529839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231529839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231529840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231529840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231529840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231529840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:31.938636 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11998): Process ended prematurely: osmo-stp_10.42.42.5(pid=11998) [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11998)] [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:15:31.949094 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 23:15:31.978300 run osmo-hlr_10.42.42.2(pid=11995): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11995)] 23:15:32.033692 run osmo-hlr_10.42.42.2(pid=11995): stdout: | (launched: 2022-12-13_23:15:28.706865) 23:15:32.090474 run osmo-hlr_10.42.42.2(pid=11995): stderr: | [0;m[1;31m20221213231528887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231528887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231528887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231528887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231528887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231528887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231528933 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231528943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231528943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231528943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:32.166516 run osmo-msc_10.42.42.6(pid=12001): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12001)] 23:15:32.221467 run osmo-msc_10.42.42.6(pid=12001): stdout: | (launched: 2022-12-13_23:15:30.653731) 23:15:32.274881 run osmo-msc_10.42.42.6(pid=12001): stderr: | [0;m[38;5;43m20221213231531044 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231531045 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb7f9eaec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231531045 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231531045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231531046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231531046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231531047 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231531048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231531048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231531048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:32.328657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11994): Terminating (SIGTERM) 23:15:32.372275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11997): Terminating (SIGTERM) 23:15:32.415589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12000): Terminating (SIGTERM) 23:15:32.459153 --- ParallelTerminationStrategy: PID 11994 died... 23:15:32.480451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11994): Terminated: ok {rc=0} 23:15:32.528406 --- ParallelTerminationStrategy: PID 11997 died... 23:15:32.549280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11997): Terminated: ok {rc=0} 23:15:32.597140 --- ParallelTerminationStrategy: PID 12000 died... 23:15:32.618016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12000): Terminated: ok {rc=0} 23:15:32.708538 bus /sierra_3: Setting Powered False 23:15:33.805669 bus /sierra_3: Setting Powered False 23:15:34.920235 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:15:36.071619 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:36.084108 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:15:36.142390 tst mo_mt_call_osmux.py: using LAC 36900 23:15:36.271290 tst mo_mt_call_osmux.py: using RAC 180 23:15:36.393464 tst mo_mt_call_osmux.py: using CellId 36900 23:15:36.516817 tst mo_mt_call_osmux.py: using BVCI 36901 23:15:36.628835 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:36.640160 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:36.651327 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:36.662269 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:36.673719 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:36.684668 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:15:36.807015 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:15:36.926951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:37.406759 run create_hlr_db(pid=12003): Launched 23:15:37.532182 bus /sierra_2: Setting Powered False 23:15:38.593934 run create_hlr_db(pid=12003): Terminated: ok {rc=0} 23:15:39.024661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12005): Launched 23:15:39.334130 run osmo-hlr_10.42.42.2(pid=12006): Launched 23:15:39.451260 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:40.000941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12008): Launched 23:15:40.310594 run osmo-stp_10.42.42.5(pid=12009): Launched 23:15:40.427635 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:41.003125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12011): Launched 23:15:41.313134 run osmo-msc_10.42.42.6(pid=12012): Launched 23:15:41.485211 run osmo-stp_10.42.42.5(pid=12009): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12009)] 23:15:41.615629 run osmo-stp_10.42.42.5(pid=12009): stdout: | (launched: 2022-12-13_23:15:40.251904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:41.746128 run osmo-stp_10.42.42.5(pid=12009): stderr: | [0;m[38;5;43m20221213231540427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231540427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231540427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231540428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231540428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231540428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231540428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:41.874366 run osmo-stp_10.42.42.5(pid=12009): stdout: | (launched: 2022-12-13_23:15:40.251904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:41.997478 run osmo-stp_10.42.42.5(pid=12009): stderr: | [0;m[38;5;43m20221213231540427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231540427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231540427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231540428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231540428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231540428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231540428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:42.144608 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12009): Process ended prematurely: osmo-stp_10.42.42.5(pid=12009) [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12009)] [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:15:42.153568 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:15:42.179706 run osmo-hlr_10.42.42.2(pid=12006): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12006)] 23:15:42.228097 run osmo-hlr_10.42.42.2(pid=12006): stdout: | (launched: 2022-12-13_23:15:39.275290) 23:15:42.277629 run osmo-hlr_10.42.42.2(pid=12006): stderr: | [0;m[1;31m20221213231539456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231539456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231539456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231539456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231539456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231539456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231539469 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231539477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231539478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231539478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:42.346389 run osmo-msc_10.42.42.6(pid=12012): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12012)] 23:15:42.393931 run osmo-msc_10.42.42.6(pid=12012): stdout: | (launched: 2022-12-13_23:15:41.254619) 23:15:42.443237 run osmo-msc_10.42.42.6(pid=12012): stderr: | [0;m[38;5;43m20221213231541531 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231541531 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe984836c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231541531 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231541531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231541531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231541531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231541533 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231541533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231541534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231541534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:42.492654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12005): Terminating (SIGTERM) 23:15:42.532324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12008): Terminating (SIGTERM) 23:15:42.572448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12011): Terminating (SIGTERM) 23:15:42.612329 --- ParallelTerminationStrategy: PID 12005 died... 23:15:42.631081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12005): Terminated: ok {rc=0} 23:15:42.674814 --- ParallelTerminationStrategy: PID 12008 died... 23:15:42.693415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12008): Terminated: ok {rc=0} 23:15:42.737068 --- ParallelTerminationStrategy: PID 12011 died... 23:15:42.755618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12011): Terminated: ok {rc=0} 23:15:42.841417 bus /sierra_3: Setting Powered False 23:15:43.939980 bus /sierra_3: Setting Powered False 23:15:45.052102 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:15:46.335269 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:15:46.346744 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:15:46.368606 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:15:46.399591 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:15:46.452614 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:15:46.476033 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:15:46.505635 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:15:47.054678 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:15:47.122455 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:47.137601 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:15:47.205786 tst mo_mt_call.py: using LAC 36901 23:15:47.337395 tst mo_mt_call.py: using RAC 181 23:15:47.466442 tst mo_mt_call.py: using CellId 36901 23:15:47.598006 tst mo_mt_call.py: using BVCI 36902 23:15:47.717648 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:47.729220 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:47.740609 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:47.751932 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:47.763592 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:47.775244 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:15:47.894646 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:15:48.010953 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:48.490221 run create_hlr_db(pid=12017): Launched 23:15:48.616156 bus /sierra_2: Setting Powered False 23:15:49.677254 run create_hlr_db(pid=12017): Terminated: ok {rc=0} 23:15:50.107228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12019): Launched 23:15:50.417071 run osmo-hlr_10.42.42.2(pid=12020): Launched 23:15:50.534754 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:51.065576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12022): Launched 23:15:51.374551 run osmo-stp_10.42.42.5(pid=12023): Launched 23:15:51.491653 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:52.050984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12028): Launched 23:15:52.361606 run osmo-msc_10.42.42.6(pid=12029): Launched 23:15:52.534117 run osmo-stp_10.42.42.5(pid=12023): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12023)] 23:15:52.665297 run osmo-stp_10.42.42.5(pid=12023): stdout: | (launched: 2022-12-13_23:15:51.316364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:52.795221 run osmo-stp_10.42.42.5(pid=12023): stderr: | [0;m[38;5;43m20221213231551489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231551489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231551489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231551490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231551490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231551490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231551490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:52.923239 run osmo-stp_10.42.42.5(pid=12023): stdout: | (launched: 2022-12-13_23:15:51.316364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:53.045496 run osmo-stp_10.42.42.5(pid=12023): stderr: | [0;m[38;5;43m20221213231551489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231551489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231551489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231551490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231551490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231551490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231551490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:53.192147 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12023): Process ended prematurely: osmo-stp_10.42.42.5(pid=12023) [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12023)] [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:15:53.200939 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:15:53.227133 run osmo-hlr_10.42.42.2(pid=12020): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12020)] 23:15:53.274927 run osmo-hlr_10.42.42.2(pid=12020): stdout: | (launched: 2022-12-13_23:15:50.358488) 23:15:53.324210 run osmo-hlr_10.42.42.2(pid=12020): stderr: | [0;m[1;31m20221213231550539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231550539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231550539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231550539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231550539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231550539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231550551 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231550562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231550562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231550562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:53.393043 run osmo-msc_10.42.42.6(pid=12029): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12029)] 23:15:53.440516 run osmo-msc_10.42.42.6(pid=12029): stdout: | (launched: 2022-12-13_23:15:52.302408) 23:15:53.489918 run osmo-msc_10.42.42.6(pid=12029): stderr: | [0;m[38;5;43m20221213231552578 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231552579 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f99dcb8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231552579 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231552579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231552579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231552579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231552581 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231552581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231552582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231552582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:53.539405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12019): Terminating (SIGTERM) 23:15:53.578819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12022): Terminating (SIGTERM) 23:15:53.618074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12028): Terminating (SIGTERM) 23:15:53.657646 --- ParallelTerminationStrategy: PID 12019 died... 23:15:53.676633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12019): Terminated: ok {rc=0} 23:15:53.720122 --- ParallelTerminationStrategy: PID 12022 died... 23:15:53.738608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12022): Terminated: ok {rc=0} 23:15:53.782093 --- ParallelTerminationStrategy: PID 12028 died... 23:15:53.800468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12028): Terminated: ok {rc=0} 23:15:53.886126 bus /sierra_3: Setting Powered False 23:15:54.985539 bus /sierra_3: Setting Powered False 23:15:56.098123 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:15:57.247557 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:57.259898 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:15:57.318475 tst mo_mt_call_osmux.py: using LAC 36902 23:15:57.448867 tst mo_mt_call_osmux.py: using RAC 182 23:15:57.579294 tst mo_mt_call_osmux.py: using CellId 36902 23:15:57.703180 tst mo_mt_call_osmux.py: using BVCI 36903 23:15:57.814820 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:57.826127 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:57.837239 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:57.848079 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:57.859198 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:57.870136 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:15:57.991769 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:15:58.110820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:58.591592 run create_hlr_db(pid=12031): Launched 23:15:58.717775 bus /sierra_2: Setting Powered False 23:15:59.778780 run create_hlr_db(pid=12031): Terminated: ok {rc=0} 23:16:00.231954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12033): Launched 23:16:00.565271 run osmo-hlr_10.42.42.2(pid=12034): Launched 23:16:00.692385 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:01.281750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12036): Launched 23:16:01.629687 run osmo-stp_10.42.42.5(pid=12037): Launched 23:16:01.897962 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:02.539737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12039): Launched 23:16:02.849994 run osmo-msc_10.42.42.6(pid=12040): Launched 23:16:03.020924 run osmo-stp_10.42.42.5(pid=12037): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12037)] 23:16:03.150111 run osmo-stp_10.42.42.5(pid=12037): stdout: | (launched: 2022-12-13_23:16:01.565340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:03.279121 run osmo-stp_10.42.42.5(pid=12037): stderr: | [0;m[38;5;43m20221213231601828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231601828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231601829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231601830 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231601831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231601832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231601833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:03.407153 run osmo-stp_10.42.42.5(pid=12037): stdout: | (launched: 2022-12-13_23:16:01.565340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:03.529456 run osmo-stp_10.42.42.5(pid=12037): stderr: | [0;m[38;5;43m20221213231601828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231601828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231601829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231601830 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231601831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231601832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231601833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:03.675711 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12037): Process ended prematurely: osmo-stp_10.42.42.5(pid=12037) [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12037)] [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:16:03.684637 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:16:03.710693 run osmo-hlr_10.42.42.2(pid=12034): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12034)] 23:16:03.758123 run osmo-hlr_10.42.42.2(pid=12034): stdout: | (launched: 2022-12-13_23:16:00.503345) 23:16:03.807367 run osmo-hlr_10.42.42.2(pid=12034): stderr: | [0;m[1;31m20221213231600704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231600704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231600704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231600704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231600704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231600704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231600717 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231600726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231600726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231600726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:03.876152 run osmo-msc_10.42.42.6(pid=12040): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12040)] 23:16:03.923594 run osmo-msc_10.42.42.6(pid=12040): stdout: | (launched: 2022-12-13_23:16:02.791620) 23:16:03.972700 run osmo-msc_10.42.42.6(pid=12040): stderr: | [0;m[38;5;43m20221213231603067 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231603067 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f43277f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231603067 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231603068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231603068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231603068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231603070 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231603070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231603070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231603070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:04.022261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12033): Terminating (SIGTERM) 23:16:04.061644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12036): Terminating (SIGTERM) 23:16:04.101120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12039): Terminating (SIGTERM) 23:16:04.140660 --- ParallelTerminationStrategy: PID 12033 died... 23:16:04.159755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12033): Terminated: ok {rc=0} 23:16:04.203543 --- ParallelTerminationStrategy: PID 12036 died... 23:16:04.222098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12036): Terminated: ok {rc=0} 23:16:04.265562 --- ParallelTerminationStrategy: PID 12039 died... 23:16:04.283944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12039): Terminated: ok {rc=0} 23:16:04.369310 bus /sierra_3: Setting Powered False 23:16:05.468159 bus /sierra_3: Setting Powered False 23:16:06.582444 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:16:07.821369 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:16:07.827910 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:16:07.848514 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:16:07.874995 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:16:07.928807 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:16:07.950241 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:16:07.976525 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:16:08.530010 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:16:08.586697 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:08.598506 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:16:08.660923 tst mo_mt_call.py: using LAC 36903 23:16:08.790295 tst mo_mt_call.py: using RAC 183 23:16:08.917954 tst mo_mt_call.py: using CellId 36903 23:16:09.047431 tst mo_mt_call.py: using BVCI 36904 23:16:09.167674 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:09.179338 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:09.190776 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:09.202164 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:09.213983 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:09.225729 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:16:09.343100 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:16:09.465418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:09.978096 run create_hlr_db(pid=12045): Launched 23:16:10.104237 bus /sierra_2: Setting Powered False 23:16:11.168731 run create_hlr_db(pid=12045): Terminated: ok {rc=0} 23:16:11.612473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12047): Launched 23:16:11.923595 run osmo-hlr_10.42.42.2(pid=12048): Launched 23:16:12.041342 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:12.591638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12050): Launched 23:16:12.903871 run osmo-stp_10.42.42.5(pid=12051): Launched 23:16:13.022034 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:13.580940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12053): Launched 23:16:13.891372 run osmo-msc_10.42.42.6(pid=12054): Launched 23:16:14.063550 run osmo-stp_10.42.42.5(pid=12051): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12051)] 23:16:14.193805 run osmo-stp_10.42.42.5(pid=12051): stdout: | (launched: 2022-12-13_23:16:12.844694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:14.323152 run osmo-stp_10.42.42.5(pid=12051): stderr: | [0;m[38;5;43m20221213231613019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231613019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231613019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231613020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231613020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231613020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231613020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:14.451467 run osmo-stp_10.42.42.5(pid=12051): stdout: | (launched: 2022-12-13_23:16:12.844694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:14.573696 run osmo-stp_10.42.42.5(pid=12051): stderr: | [0;m[38;5;43m20221213231613019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231613019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231613019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231613020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231613020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231613020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231613020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:14.720526 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12051): Process ended prematurely: osmo-stp_10.42.42.5(pid=12051) [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12051)] [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:16:14.729352 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:16:14.755565 run osmo-hlr_10.42.42.2(pid=12048): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12048)] 23:16:14.804399 run osmo-hlr_10.42.42.2(pid=12048): stdout: | (launched: 2022-12-13_23:16:11.865258) 23:16:14.854303 run osmo-hlr_10.42.42.2(pid=12048): stderr: | [0;m[1;31m20221213231612042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231612042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231612042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231612042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231612042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231612042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231612055 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231612066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231612066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231612066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:14.923234 run osmo-msc_10.42.42.6(pid=12054): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12054)] 23:16:14.970891 run osmo-msc_10.42.42.6(pid=12054): stdout: | (launched: 2022-12-13_23:16:13.832617) 23:16:15.020175 run osmo-msc_10.42.42.6(pid=12054): stderr: | [0;m[38;5;43m20221213231614108 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231614108 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f22d8f7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231614108 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231614109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231614109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231614109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231614111 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231614111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231614111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231614111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:15.069815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12047): Terminating (SIGTERM) 23:16:15.109458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12050): Terminating (SIGTERM) 23:16:15.149194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12053): Terminating (SIGTERM) 23:16:15.189337 --- ParallelTerminationStrategy: PID 12047 died... 23:16:15.208629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12047): Terminated: ok {rc=0} 23:16:15.252852 --- ParallelTerminationStrategy: PID 12050 died... 23:16:15.272078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12050): Terminated: ok {rc=0} 23:16:15.316882 --- ParallelTerminationStrategy: PID 12053 died... 23:16:15.336074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12053): Terminated: ok {rc=0} 23:16:15.422431 bus /sierra_3: Setting Powered False 23:16:16.527605 bus /sierra_3: Setting Powered False 23:16:17.653079 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:16:18.803940 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:18.816222 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:16:18.875276 tst mo_mt_call_osmux.py: using LAC 36904 23:16:19.005432 tst mo_mt_call_osmux.py: using RAC 184 23:16:19.136197 tst mo_mt_call_osmux.py: using CellId 36904 23:16:19.264927 tst mo_mt_call_osmux.py: using BVCI 36905 23:16:19.385749 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:19.397436 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:19.408698 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:19.420278 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:19.432040 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:19.443841 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:16:19.565595 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:16:19.687773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:20.168241 run create_hlr_db(pid=12056): Launched 23:16:20.294887 bus /sierra_2: Setting Powered False 23:16:21.355648 run create_hlr_db(pid=12056): Terminated: ok {rc=0} 23:16:21.787269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12058): Launched 23:16:22.097812 run osmo-hlr_10.42.42.2(pid=12059): Launched 23:16:22.215044 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:22.745998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12061): Launched 23:16:23.056905 run osmo-stp_10.42.42.5(pid=12062): Launched 23:16:23.174832 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:23.732128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12064): Launched 23:16:24.041984 run osmo-msc_10.42.42.6(pid=12065): Launched 23:16:24.213541 run osmo-stp_10.42.42.5(pid=12062): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12062)] 23:16:24.346957 run osmo-stp_10.42.42.5(pid=12062): stdout: | (launched: 2022-12-13_23:16:22.998848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:24.477448 run osmo-stp_10.42.42.5(pid=12062): stderr: | [0;m[38;5;43m20221213231623172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231623172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231623173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231623173 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231623173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231623174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231623174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:24.605337 run osmo-stp_10.42.42.5(pid=12062): stdout: | (launched: 2022-12-13_23:16:22.998848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:24.727710 run osmo-stp_10.42.42.5(pid=12062): stderr: | [0;m[38;5;43m20221213231623172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231623172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231623173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231623173 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231623173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231623174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231623174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:24.874737 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12062): Process ended prematurely: osmo-stp_10.42.42.5(pid=12062) [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12062)] [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:16:24.883635 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:16:24.910017 run osmo-hlr_10.42.42.2(pid=12059): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12059)] 23:16:24.957971 run osmo-hlr_10.42.42.2(pid=12059): stdout: | (launched: 2022-12-13_23:16:22.039305) 23:16:25.007184 run osmo-hlr_10.42.42.2(pid=12059): stderr: | [0;m[1;31m20221213231622218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231622218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231622218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231622218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231622218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231622218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231622230 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231622239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231622239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231622239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:25.075778 run osmo-msc_10.42.42.6(pid=12065): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12065)] 23:16:25.123335 run osmo-msc_10.42.42.6(pid=12065): stdout: | (launched: 2022-12-13_23:16:23.983318) 23:16:25.172675 run osmo-msc_10.42.42.6(pid=12065): stderr: | [0;m[38;5;43m20221213231624259 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231624259 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3af158dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231624260 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231624260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231624260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231624260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231624262 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231624262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231624262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231624262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:25.221955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12058): Terminating (SIGTERM) 23:16:25.261438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12061): Terminating (SIGTERM) 23:16:25.301103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12064): Terminating (SIGTERM) 23:16:25.340942 --- ParallelTerminationStrategy: PID 12058 died... 23:16:25.360025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12058): Terminated: ok {rc=0} 23:16:25.403892 --- ParallelTerminationStrategy: PID 12061 died... 23:16:25.422571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12061): Terminated: ok {rc=0} 23:16:25.466302 --- ParallelTerminationStrategy: PID 12064 died... 23:16:25.484913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12064): Terminated: ok {rc=0} 23:16:25.571073 bus /sierra_3: Setting Powered False 23:16:26.670694 bus /sierra_3: Setting Powered False 23:16:27.785981 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:16:29.024249 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:16:29.032285 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:16:29.053873 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:16:29.082488 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:16:29.135643 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:16:29.157632 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:16:29.185096 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:16:29.734126 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:16:29.784342 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:29.795627 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:16:29.854738 tst mo_mt_call.py: using LAC 36905 23:16:29.978922 tst mo_mt_call.py: using RAC 185 23:16:30.099688 tst mo_mt_call.py: using CellId 36905 23:16:30.220186 tst mo_mt_call.py: using BVCI 36906 23:16:30.331474 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:30.342568 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:30.353518 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:30.364333 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:30.375243 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:30.386782 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:16:30.509179 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:16:30.628730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:31.116603 run create_hlr_db(pid=12070): Launched 23:16:31.277895 bus /sierra_2: Setting Powered False 23:16:32.339494 run create_hlr_db(pid=12070): Terminated: ok {rc=0} 23:16:32.771801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12072): Launched 23:16:33.083034 run osmo-hlr_10.42.42.2(pid=12073): Launched 23:16:33.200674 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:33.747905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12075): Launched 23:16:34.058593 run osmo-stp_10.42.42.5(pid=12076): Launched 23:16:34.175436 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:34.735173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12078): Launched 23:16:35.046515 run osmo-msc_10.42.42.6(pid=12079): Launched 23:16:35.218795 run osmo-stp_10.42.42.5(pid=12076): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12076)] 23:16:35.348675 run osmo-stp_10.42.42.5(pid=12076): stdout: | (launched: 2022-12-13_23:16:33.999570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:35.478648 run osmo-stp_10.42.42.5(pid=12076): stderr: | [0;m[38;5;43m20221213231634173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231634173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231634174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231634174 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231634175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231634175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231634175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:35.606866 run osmo-stp_10.42.42.5(pid=12076): stdout: | (launched: 2022-12-13_23:16:33.999570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:35.729549 run osmo-stp_10.42.42.5(pid=12076): stderr: | [0;m[38;5;43m20221213231634173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231634173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231634174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231634174 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231634175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231634175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231634175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:35.876279 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12076): Process ended prematurely: osmo-stp_10.42.42.5(pid=12076) [trial-2396↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12076)] [trial-2396↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:16:35.885389 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:16:35.911446 run osmo-hlr_10.42.42.2(pid=12073): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12073)] 23:16:35.959426 run osmo-hlr_10.42.42.2(pid=12073): stdout: | (launched: 2022-12-13_23:16:33.024380) 23:16:36.008563 run osmo-hlr_10.42.42.2(pid=12073): stderr: | [0;m[1;31m20221213231633207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231633207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231633207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231633207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231633207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231633207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231633219 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231633228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231633228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231633228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:36.077230 run osmo-msc_10.42.42.6(pid=12079): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12079)] 23:16:36.124607 run osmo-msc_10.42.42.6(pid=12079): stdout: | (launched: 2022-12-13_23:16:34.987735) 23:16:36.173918 run osmo-msc_10.42.42.6(pid=12079): stderr: | [0;m[38;5;43m20221213231635263 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231635263 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd34bf3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231635263 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231635263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231635264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231635264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231635266 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231635266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231635266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231635266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:36.223220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12072): Terminating (SIGTERM) 23:16:36.262577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12075): Terminating (SIGTERM) 23:16:36.302773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12078): Terminating (SIGTERM) 23:16:36.342526 --- ParallelTerminationStrategy: PID 12072 died... 23:16:36.361656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12072): Terminated: ok {rc=0} 23:16:36.405287 --- ParallelTerminationStrategy: PID 12075 died... 23:16:36.423865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12075): Terminated: ok {rc=0} 23:16:36.467506 --- ParallelTerminationStrategy: PID 12078 died... 23:16:36.486105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12078): Terminated: ok {rc=0} 23:16:36.568649 bus /sierra_3: Setting Powered False 23:16:37.665664 bus /sierra_3: Setting Powered False 23:16:38.776723 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:16:39.926399 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:39.938897 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:16:39.999141 tst mo_mt_call_osmux.py: using LAC 36906 23:16:40.130068 tst mo_mt_call_osmux.py: using RAC 186 23:16:40.261566 tst mo_mt_call_osmux.py: using CellId 36906 23:16:40.394104 tst mo_mt_call_osmux.py: using BVCI 36907 23:16:40.516530 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:40.528584 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:40.540118 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:40.551516 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:40.563504 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:40.575389 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:16:40.695330 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:16:40.817043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:41.331541 run create_hlr_db(pid=12081): Launched 23:16:41.459899 bus /sierra_2: Setting Powered False 23:16:42.524427 run create_hlr_db(pid=12081): Terminated: ok {rc=0} 23:16:42.967505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12083): Launched 23:16:43.280008 run osmo-hlr_10.42.42.2(pid=12084): Launched 23:16:43.408692 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:43.978634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12086): Launched 23:16:44.310815 run osmo-stp_10.42.42.5(pid=12087): Launched 23:16:44.437691 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:45.035603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12089): Launched 23:16:45.366985 run osmo-msc_10.42.42.6(pid=12090): Launched 23:16:45.551553 run osmo-stp_10.42.42.5(pid=12087): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12087)] 23:16:45.690546 run osmo-stp_10.42.42.5(pid=12087): stdout: | (launched: 2022-12-13_23:16:44.248901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:45.840023 run osmo-stp_10.42.42.5(pid=12087): stderr: | [0;m[38;5;43m20221213231644445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231644445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231644445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231644445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231644446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231644446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231644446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:46.018520 run osmo-stp_10.42.42.5(pid=12087): stdout: | (launched: 2022-12-13_23:16:44.248901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:46.153078 run osmo-stp_10.42.42.5(pid=12087): stderr: | [0;m[38;5;43m20221213231644445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231644445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231644445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231644445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231644446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231644446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231644446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:46.314355 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12087): Process ended prematurely: osmo-stp_10.42.42.5(pid=12087) [trial-2396↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12087)] [trial-2396↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:16:46.324767 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:16:46.353722 run osmo-hlr_10.42.42.2(pid=12084): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12084)] 23:16:46.408798 run osmo-hlr_10.42.42.2(pid=12084): stdout: | (launched: 2022-12-13_23:16:43.221631) 23:16:46.462920 run osmo-hlr_10.42.42.2(pid=12084): stderr: | [0;m[1;31m20221213231643418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231643418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231643418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231643418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231643418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231643418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231643431 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231643439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231643440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231643440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:46.537746 run osmo-msc_10.42.42.6(pid=12090): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12090)] 23:16:46.588742 run osmo-msc_10.42.42.6(pid=12090): stdout: | (launched: 2022-12-13_23:16:45.305195) 23:16:46.643922 run osmo-msc_10.42.42.6(pid=12090): stderr: | [0;m[38;5;43m20221213231645629 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231645630 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa3d838cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231645630 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231645630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231645630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231645630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231645632 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231645632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231645632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231645632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:46.698249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12083): Terminating (SIGTERM) 23:16:46.741625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12086): Terminating (SIGTERM) 23:16:46.787549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12089): Terminating (SIGTERM) 23:16:46.833155 --- ParallelTerminationStrategy: PID 12083 died... 23:16:46.855086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12083): Terminated: ok {rc=0} 23:16:46.903271 --- ParallelTerminationStrategy: PID 12086 died... 23:16:46.924843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12086): Terminated: ok {rc=0} 23:16:46.973074 --- ParallelTerminationStrategy: PID 12089 died... 23:16:46.994591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12089): Terminated: ok {rc=0} 23:16:47.091920 bus /sierra_3: Setting Powered False 23:16:48.194432 bus /sierra_3: Setting Powered False 23:16:49.309931 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:16:50.547906 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:16:50.554648 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:16:50.575962 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:16:50.602763 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:16:50.655736 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:16:50.678121 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:16:50.704526 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:16:51.250836 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:16:51.300215 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:51.311242 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:16:51.368238 tst mo_mt_call.py: using LAC 36907 23:16:51.499149 tst mo_mt_call.py: using RAC 187 23:16:51.629258 tst mo_mt_call.py: using CellId 36907 23:16:51.759740 tst mo_mt_call.py: using BVCI 36908 23:16:51.879271 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:51.891067 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:51.902447 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:51.913616 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:51.925099 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:51.936818 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:16:52.056173 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:16:52.175389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:52.655132 run create_hlr_db(pid=12095): Launched 23:16:52.782921 bus /sierra_2: Setting Powered False 23:16:53.845541 run create_hlr_db(pid=12095): Terminated: ok {rc=0} 23:16:54.298235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12097): Launched 23:16:54.630228 run osmo-hlr_10.42.42.2(pid=12098): Launched 23:16:54.756121 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:55.334390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12100): Launched 23:16:55.669908 run osmo-stp_10.42.42.5(pid=12101): Launched 23:16:55.797480 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:56.400263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12103): Launched 23:16:56.734237 run osmo-msc_10.42.42.6(pid=12104): Launched 23:16:56.918683 run osmo-stp_10.42.42.5(pid=12101): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12101)] 23:16:57.059044 run osmo-stp_10.42.42.5(pid=12101): stdout: | (launched: 2022-12-13_23:16:55.606888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:57.200179 run osmo-stp_10.42.42.5(pid=12101): stderr: | [0;m[38;5;43m20221213231655801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231655801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231655801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231655802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231655802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231655802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231655802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:57.339151 run osmo-stp_10.42.42.5(pid=12101): stdout: | (launched: 2022-12-13_23:16:55.606888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:57.471977 run osmo-stp_10.42.42.5(pid=12101): stderr: | [0;m[38;5;43m20221213231655801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231655801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231655801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231655802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231655802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231655802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231655802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:57.629941 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12101): Process ended prematurely: osmo-stp_10.42.42.5(pid=12101) [trial-2396↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12101)] [trial-2396↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:16:57.639446 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:16:57.667039 run osmo-hlr_10.42.42.2(pid=12098): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12098)] 23:16:57.717858 run osmo-hlr_10.42.42.2(pid=12098): stdout: | (launched: 2022-12-13_23:16:54.568321) 23:16:57.769733 run osmo-hlr_10.42.42.2(pid=12098): stderr: | [0;m[1;31m20221213231654770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231654770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231654770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231654770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231654770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231654770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231654786 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231654796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231654796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231654796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:57.842500 run osmo-msc_10.42.42.6(pid=12104): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12104)] 23:16:57.892408 run osmo-msc_10.42.42.6(pid=12104): stdout: | (launched: 2022-12-13_23:16:56.671756) 23:16:57.944504 run osmo-msc_10.42.42.6(pid=12104): stderr: | [0;m[38;5;43m20221213231656995 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231656996 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4a5ba41c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231656996 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231656996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231656996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231656996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231656998 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231656998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231656998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231656998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:57.996782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12097): Terminating (SIGTERM) 23:16:58.039100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12100): Terminating (SIGTERM) 23:16:58.081171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12103): Terminating (SIGTERM) 23:16:58.124102 --- ParallelTerminationStrategy: PID 12097 died... 23:16:58.145170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12097): Terminated: ok {rc=0} 23:16:58.191588 --- ParallelTerminationStrategy: PID 12100 died... 23:16:58.211513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12100): Terminated: ok {rc=0} 23:16:58.257773 --- ParallelTerminationStrategy: PID 12103 died... 23:16:58.277660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12103): Terminated: ok {rc=0} 23:16:58.366856 bus /sierra_3: Setting Powered False 23:16:59.467721 bus /sierra_3: Setting Powered False 23:17:00.587527 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:17:01.770072 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:17:01.787270 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:17:01.859970 tst mo_mt_call_osmux.py: using LAC 36908 23:17:02.029398 tst mo_mt_call_osmux.py: using RAC 188 23:17:02.160446 tst mo_mt_call_osmux.py: using CellId 36908 23:17:02.297877 tst mo_mt_call_osmux.py: using BVCI 36909 23:17:02.420820 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:17:02.432569 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:17:02.444157 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:17:02.455637 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:17:02.467901 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:17:02.480330 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:17:02.599905 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:17:02.723775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:03.207868 run create_hlr_db(pid=12109): Launched 23:17:03.333579 bus /sierra_2: Setting Powered False 23:17:04.394492 run create_hlr_db(pid=12109): Terminated: ok {rc=0} 23:17:04.846111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12111): Launched 23:17:05.178137 run osmo-hlr_10.42.42.2(pid=12112): Launched 23:17:05.304125 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:05.876604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12114): Launched 23:17:06.208398 run osmo-stp_10.42.42.5(pid=12115): Launched 23:17:06.335111 run osmo-msc_10.42.42.6: Starting osmo-msc 23:17:06.934540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12117): Launched 23:17:07.267107 run osmo-msc_10.42.42.6(pid=12118): Launched 23:17:07.451677 run osmo-stp_10.42.42.5(pid=12115): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12115)] 23:17:07.592104 run osmo-stp_10.42.42.5(pid=12115): stdout: | (launched: 2022-12-13_23:17:06.146436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:07.732578 run osmo-stp_10.42.42.5(pid=12115): stderr: | [0;m[38;5;43m20221213231706341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231706341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231706341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231706341 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231706342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231706342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231706342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:07.872202 run osmo-stp_10.42.42.5(pid=12115): stdout: | (launched: 2022-12-13_23:17:06.146436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:08.003775 run osmo-stp_10.42.42.5(pid=12115): stderr: | [0;m[38;5;43m20221213231706341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231706341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231706341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231706341 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231706342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231706342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231706342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:08.161177 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12115): Process ended prematurely: osmo-stp_10.42.42.5(pid=12115) [trial-2396↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12115)] [trial-2396↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:17:08.170880 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:17:08.198728 run osmo-hlr_10.42.42.2(pid=12112): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12112)] 23:17:08.249844 run osmo-hlr_10.42.42.2(pid=12112): stdout: | (launched: 2022-12-13_23:17:05.116060) 23:17:08.302171 run osmo-hlr_10.42.42.2(pid=12112): stderr: | [0;m[1;31m20221213231705321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231705321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231705321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231705321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231705321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231705321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231705334 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231705342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231705342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231705342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:08.374983 run osmo-msc_10.42.42.6(pid=12118): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12118)] 23:17:08.425068 run osmo-msc_10.42.42.6(pid=12118): stdout: | (launched: 2022-12-13_23:17:07.204257) 23:17:08.477240 run osmo-msc_10.42.42.6(pid=12118): stderr: | [0;m[38;5;43m20221213231707530 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231707530 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1f63aabc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231707530 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231707530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231707531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231707531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231707532 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231707533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231707533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231707533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:17:08.529432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12111): Terminating (SIGTERM) 23:17:08.571420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12114): Terminating (SIGTERM) 23:17:08.613249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12117): Terminating (SIGTERM) 23:17:08.655309 --- ParallelTerminationStrategy: PID 12111 died... 23:17:08.675541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12111): Terminated: ok {rc=0} 23:17:08.721739 --- ParallelTerminationStrategy: PID 12114 died... 23:17:08.741688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12114): Terminated: ok {rc=0} 23:17:08.788069 --- ParallelTerminationStrategy: PID 12117 died... 23:17:08.808092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12117): Terminated: ok {rc=0} 23:17:08.896907 bus /sierra_3: Setting Powered False 23:17:09.997152 bus /sierra_3: Setting Powered False 23:17:11.116021 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 emergency:sysmo --------------------------------------------------------------------- 23:17:12.346793 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:17:12.351086 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 23:17:12.371879 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 23:17:12.398617 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 23:17:12.482427 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 23:17:12.503187 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 23:17:12.529502 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 23:17:13.117548 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2396 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 23:17:13.123130 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:13.134580 tst emergency:sysmo: Using 1 x bts (candidates: 1) 23:17:13.171673 tst emergency_mo_mt_call.py: using LAC 36909 23:17:13.300309 tst emergency_mo_mt_call.py: using RAC 189 23:17:13.429611 tst emergency_mo_mt_call.py: using CellId 36909 23:17:13.556673 tst emergency_mo_mt_call.py: using BVCI 36910 23:17:13.676395 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:13.687828 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:13.699065 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:13.710267 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:13.722019 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:13.733720 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:13.852536 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:13.973615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:14.483650 run create_hlr_db(pid=12123): Launched 23:17:14.607921 bus /sierra_2: Setting Powered False 23:17:15.672642 run create_hlr_db(pid=12123): Terminated: ok {rc=0} 23:17:16.162325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12125): Launched 23:17:16.501638 run osmo-hlr_10.42.42.2(pid=12126): Launched 23:17:16.653527 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:17.425853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12128): Launched 23:17:17.753817 run osmo-stp_10.42.42.5(pid=12129): Launched 23:17:17.887620 tst emergency_mo_mt_call.py: using MSISDN 8385 23:17:18.057692 run osmo-msc_10.42.42.6: Starting osmo-msc 23:17:18.645865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12131): Launched 23:17:18.974015 run osmo-msc_10.42.42.6(pid=12132): Launched 23:17:19.155937 run osmo-stp_10.42.42.5(pid=12129): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12129)] 23:17:19.294365 run osmo-stp_10.42.42.5(pid=12129): stdout: | (launched: 2022-12-13_23:17:17.692413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:19.433402 run osmo-stp_10.42.42.5(pid=12129): stderr: | [0;m[38;5;43m20221213231717888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231717888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231717888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231717889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231717891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231717891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231717892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:19.570813 run osmo-stp_10.42.42.5(pid=12129): stdout: | (launched: 2022-12-13_23:17:17.692413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:19.700931 run osmo-stp_10.42.42.5(pid=12129): stderr: | [0;m[38;5;43m20221213231717888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231717888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231717888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231717889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231717891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231717891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231717892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:19.856104 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12129): Process ended prematurely: osmo-stp_10.42.42.5(pid=12129) [trial-2396↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12129)] [trial-2396↪emergency:sysmo↪emergency_mo_mt_call.py:19] 23:17:19.865271 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 23:17:19.893271 run osmo-hlr_10.42.42.2(pid=12126): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12126)] 23:17:19.944566 run osmo-hlr_10.42.42.2(pid=12126): stdout: | (launched: 2022-12-13_23:17:16.433605) 23:17:19.997288 run osmo-hlr_10.42.42.2(pid=12126): stderr: | [0;m[1;31m20221213231716806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231716806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231716806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231716806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231716809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231716809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231716826 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231716839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231716839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231716839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:20.070704 run osmo-msc_10.42.42.6(pid=12132): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12132)] 23:17:20.121218 run osmo-msc_10.42.42.6(pid=12132): stdout: | (launched: 2022-12-13_23:17:18.912437) 23:17:20.173621 run osmo-msc_10.42.42.6(pid=12132): stderr: | [0;m[38;5;43m20221213231719235 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231719235 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f70c1befc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231719235 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231719235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231719235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231719236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231719237 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231719238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231719238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231719238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:17:20.226390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12125): Terminating (SIGTERM) 23:17:20.268998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12128): Terminating (SIGTERM) 23:17:20.311998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12131): Terminating (SIGTERM) 23:17:20.355015 --- ParallelTerminationStrategy: PID 12125 died... 23:17:20.375870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12125): Terminated: ok {rc=0} 23:17:20.423808 --- ParallelTerminationStrategy: PID 12128 died... 23:17:20.444263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12128): Terminated: ok {rc=0} 23:17:20.491516 --- ParallelTerminationStrategy: PID 12131 died... 23:17:20.511842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12131): Terminated: ok {rc=0} 23:17:20.601153 bus /sierra_3: Setting Powered False 23:17:21.700925 bus /sierra_3: Setting Powered False 23:17:22.816754 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 23:17:23.904489 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:23.916509 tst emergency:sysmo: Using 1 x bts (candidates: 1) 23:17:23.954020 tst emergency_preemptive_call.py: using LAC 36910 23:17:24.085703 tst emergency_preemptive_call.py: using RAC 190 23:17:24.213904 tst emergency_preemptive_call.py: using CellId 36910 23:17:24.341049 tst emergency_preemptive_call.py: using BVCI 36911 23:17:24.461504 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:24.472648 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:24.483705 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:24.494678 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:24.506492 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:24.518279 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:24.636911 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:24.758238 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:24.875382 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:24.994427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:25.501248 run create_hlr_db(pid=12134): Launched 23:17:25.624891 bus /sierra_2: Setting Powered False 23:17:26.688922 run create_hlr_db(pid=12134): Terminated: ok {rc=0} 23:17:27.127575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12136): Launched 23:17:27.436431 run osmo-hlr_10.42.42.2(pid=12137): Launched 23:17:27.554476 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:28.080913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12139): Launched 23:17:28.387004 run osmo-stp_10.42.42.5(pid=12140): Launched 23:17:28.512910 tst emergency_preemptive_call.py: using MSISDN 8386 23:17:28.668597 run osmo-msc_10.42.42.6: Starting osmo-msc 23:17:29.217175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12142): Launched 23:17:29.524641 run osmo-msc_10.42.42.6(pid=12143): Launched 23:17:29.702354 run osmo-stp_10.42.42.5(pid=12140): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12140)] 23:17:29.831651 run osmo-stp_10.42.42.5(pid=12140): stdout: | (launched: 2022-12-13_23:17:28.329177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:29.960717 run osmo-stp_10.42.42.5(pid=12140): stderr: | [0;m[38;5;43m20221213231728504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231728504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231728504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231728505 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231728506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231728506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231728506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:30.087651 run osmo-stp_10.42.42.5(pid=12140): stdout: | (launched: 2022-12-13_23:17:28.329177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:30.208485 run osmo-stp_10.42.42.5(pid=12140): stderr: | [0;m[38;5;43m20221213231728504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231728504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231728504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231728505 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231728506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231728506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231728506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:30.353136 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12140): Process ended prematurely: osmo-stp_10.42.42.5(pid=12140) [trial-2396↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12140)] [trial-2396↪emergency:sysmo↪emergency_preemptive_call.py:32] 23:17:30.361511 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 23:17:30.387443 run osmo-hlr_10.42.42.2(pid=12137): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12137)] 23:17:30.435082 run osmo-hlr_10.42.42.2(pid=12137): stdout: | (launched: 2022-12-13_23:17:27.377948) 23:17:30.484815 run osmo-hlr_10.42.42.2(pid=12137): stderr: | [0;m[1;31m20221213231727557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231727557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231727557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231727557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231727557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231727557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231727569 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231727578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231727578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231727578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:30.553763 run osmo-msc_10.42.42.6(pid=12143): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12143)] 23:17:30.601618 run osmo-msc_10.42.42.6(pid=12143): stdout: | (launched: 2022-12-13_23:17:29.466365) 23:17:30.650856 run osmo-msc_10.42.42.6(pid=12143): stderr: | [0;m[38;5;43m20221213231729743 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213231729744 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f407ea7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213231729744 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213231729744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213231729744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213231729744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213231729746 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213231729746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213231729747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213231729747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:17:30.700197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12136): Terminating (SIGTERM) 23:17:30.739915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12139): Terminating (SIGTERM) 23:17:30.779638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12142): Terminating (SIGTERM) 23:17:30.819507 --- ParallelTerminationStrategy: PID 12136 died... 23:17:30.858450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12136): Terminated: ok {rc=0} 23:17:30.916038 --- ParallelTerminationStrategy: PID 12139 died... 23:17:30.936623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12139): Terminated: ok {rc=0} 23:17:30.985756 --- ParallelTerminationStrategy: PID 12142 died... 23:17:31.007769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12142): Terminated: ok {rc=0} 23:17:31.103221 bus /sierra_9: Setting Powered False 23:17:32.217298 bus /sierra_9: Setting Powered False 23:17:33.342903 bus /sierra_8: Setting Powered False 23:17:34.441405 bus /sierra_8: Setting Powered False 23:17:35.557573 bus /sierra_3: Setting Powered False 23:17:36.655576 bus /sierra_3: Setting Powered False 23:17:37.773320 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:sysmo --------------------------------------------------------------------- 23:17:39.036390 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:17:39.041172 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 23:17:39.062616 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 23:17:39.102752 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 23:17:39.193294 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 23:17:39.214764 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 23:17:39.254692 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 23:17:39.845883 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 23:17:39.901702 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:39.912806 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:17:39.948868 tst cs_paging_gprs_active.py: using LAC 36911 23:17:40.079363 tst cs_paging_gprs_active.py: using RAC 191 23:17:40.208212 tst cs_paging_gprs_active.py: using CellId 36911 23:17:40.340078 tst cs_paging_gprs_active.py: using BVCI 36912 23:17:40.463091 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:40.474316 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:40.485478 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:40.496330 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:40.507643 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:40.519043 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:40.530499 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:40.541900 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:40.553497 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:40.675928 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:40.794468 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:17:41.004317 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:41.318648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12148): Launched 23:17:41.591561 run iperf3-srv_10.42.42.10(pid=12149): Launched 23:17:41.707603 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:17:41.915744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:42.228303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12150): Launched 23:17:42.499493 run iperf3-srv_10.42.42.10(pid=12151): Launched 23:17:42.615407 tst cs_paging_gprs_active.py:38: start network... 23:17:42.823881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:43.305639 run create_hlr_db(pid=12152): Launched 23:17:43.432239 bus /sierra_2: Setting Powered False 23:17:44.496440 run create_hlr_db(pid=12152): Terminated: ok {rc=0} 23:17:44.941637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12154): Launched 23:17:45.252120 run osmo-hlr_10.42.42.2(pid=12155): Launched 23:17:45.370233 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:45.925693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12157): Launched 23:17:46.291952 run osmo-stp_10.42.42.5(pid=12158): Launched 23:17:46.430246 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:17:48.154001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12160): Launched 23:17:48.273184 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:17:48.537699 run patchelf(pid=12161): Launched 23:17:48.710685 run osmo-stp_10.42.42.5(pid=12158): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12158)] 23:17:48.842094 run osmo-stp_10.42.42.5(pid=12158): stdout: | (launched: 2022-12-13_23:17:46.223286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:48.975636 run osmo-stp_10.42.42.5(pid=12158): stderr: | [0;m[38;5;43m20221213231746579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231746579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231746579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231746580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231746580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231746580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231746580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:49.109118 run osmo-stp_10.42.42.5(pid=12158): stdout: | (launched: 2022-12-13_23:17:46.223286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:49.235889 run osmo-stp_10.42.42.5(pid=12158): stderr: | [0;m[38;5;43m20221213231746579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231746579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231746579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231746580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231746580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231746580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231746580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:49.386478 run patchelf(pid=12161): Terminating (SIGINT) 23:17:49.561679 run patchelf(pid=12161): Terminated: ok {rc=0} 23:17:49.687484 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12158): Process ended prematurely: osmo-stp_10.42.42.5(pid=12158) [trial-2396↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12158)] [trial-2396↪gprs:sysmo↪cs_paging_gprs_active.py:38] 23:17:49.697067 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 23:17:49.724569 run osmo-hlr_10.42.42.2(pid=12155): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12155)] 23:17:49.773070 run osmo-hlr_10.42.42.2(pid=12155): stdout: | (launched: 2022-12-13_23:17:45.193608) 23:17:49.823040 run osmo-hlr_10.42.42.2(pid=12155): stderr: | [0;m[1;31m20221213231745373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231745373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231745373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231745373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231745373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231745373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231745387 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231745395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231745396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231745396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:49.873402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12148): Terminating (SIGTERM) 23:17:49.913813 run iperf3-srv_10.42.42.10(pid=12149): Terminating (SIGTERM) 23:17:49.953908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12150): Terminating (SIGTERM) 23:17:49.994028 run iperf3-srv_10.42.42.10(pid=12151): Terminating (SIGTERM) 23:17:50.034324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12154): Terminating (SIGTERM) 23:17:50.074575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12157): Terminating (SIGTERM) 23:17:50.114631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12160): Terminating (SIGTERM) 23:17:50.155014 --- ParallelTerminationStrategy: PID 12148 died... 23:17:50.174455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12148): Terminated: ok {rc=0} 23:17:50.218971 --- ParallelTerminationStrategy: PID 12149 died... 23:17:50.237914 run iperf3-srv_10.42.42.10(pid=12149): Terminated {rc=256} 23:17:50.282126 --- ParallelTerminationStrategy: PID 12150 died... 23:17:50.301291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12150): Terminated: ok {rc=0} 23:17:50.345717 --- ParallelTerminationStrategy: PID 12151 died... 23:17:50.364726 run iperf3-srv_10.42.42.10(pid=12151): Terminated {rc=256} 23:17:50.409319 --- ParallelTerminationStrategy: PID 12154 died... 23:17:50.428306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12154): Terminated: ok {rc=0} 23:17:50.472443 --- ParallelTerminationStrategy: PID 12157 died... 23:17:50.491495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12157): Terminated: ok {rc=0} 23:17:50.535747 --- ParallelTerminationStrategy: PID 12160 died... 23:17:50.554872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12160): Terminated: ok {rc=0} 23:17:50.641588 bus /gobi_0: Setting Powered False 23:17:51.742376 bus /gobi_0: Setting Powered False 23:17:52.857580 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo iperf3.py ---------------------------------------------- 23:17:54.007120 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:54.018679 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:17:54.054161 tst iperf3.py: using LAC 36912 23:17:54.176743 tst iperf3.py: using RAC 192 23:17:54.299684 tst iperf3.py: using CellId 36912 23:17:54.422900 tst iperf3.py: using BVCI 36913 23:17:54.537598 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:54.548014 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:54.558529 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:54.568890 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:54.579229 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:54.589780 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:54.600351 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:54.610911 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:54.621639 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:54.743767 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:17:54.969545 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:55.304670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12162): Launched 23:17:55.598734 run iperf3-srv_10.42.42.10(pid=12163): Launched 23:17:55.723370 tst iperf3.py:8: start network... 23:17:55.948011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:56.464780 run create_hlr_db(pid=12164): Launched 23:17:56.592548 bus /gobi_6: Setting Powered False 23:17:57.658441 run create_hlr_db(pid=12164): Terminated: ok {rc=0} 23:17:58.103174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12166): Launched 23:17:58.415193 run osmo-hlr_10.42.42.2(pid=12167): Launched 23:17:58.533352 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:59.067394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12169): Launched 23:17:59.378438 run osmo-stp_10.42.42.5(pid=12170): Launched 23:17:59.496588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:00.032847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12172): Launched 23:18:00.151179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:00.415481 run patchelf(pid=12173): Launched 23:18:00.587486 run osmo-stp_10.42.42.5(pid=12170): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12170)] 23:18:00.718564 run osmo-stp_10.42.42.5(pid=12170): stdout: | (launched: 2022-12-13_23:17:59.319608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:00.860648 run osmo-stp_10.42.42.5(pid=12170): stderr: | [0;m[38;5;43m20221213231759494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231759494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231759495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231759495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231759496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231759496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231759496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:01.002143 run osmo-stp_10.42.42.5(pid=12170): stdout: | (launched: 2022-12-13_23:17:59.319608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:01.182242 run osmo-stp_10.42.42.5(pid=12170): stderr: | [0;m[38;5;43m20221213231759494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231759494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231759495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231759495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231759496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231759496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231759496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:01.361815 run patchelf(pid=12173): Terminating (SIGINT) 23:18:01.542003 run patchelf(pid=12173): Terminated: ok {rc=0} 23:18:01.671147 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12170): Process ended prematurely: osmo-stp_10.42.42.5(pid=12170) [trial-2396↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12170)] [trial-2396↪gprs:sysmo↪iperf3.py:8] 23:18:01.681073 tst iperf3.py:8: Test FAILED (7.7 sec) 23:18:01.709149 run osmo-hlr_10.42.42.2(pid=12167): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12167)] 23:18:01.759134 run osmo-hlr_10.42.42.2(pid=12167): stdout: | (launched: 2022-12-13_23:17:58.356067) 23:18:01.810590 run osmo-hlr_10.42.42.2(pid=12167): stderr: | [0;m[1;31m20221213231758537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231758537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231758537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231758537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231758537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231758537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231758549 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231758558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231758558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231758558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:01.862513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12162): Terminating (SIGTERM) 23:18:01.904388 run iperf3-srv_10.42.42.10(pid=12163): Terminating (SIGTERM) 23:18:01.950530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12166): Terminating (SIGTERM) 23:18:01.991973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12169): Terminating (SIGTERM) 23:18:02.033223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12172): Terminating (SIGTERM) 23:18:02.076271 --- ParallelTerminationStrategy: PID 12162 died... 23:18:02.096063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12162): Terminated: ok {rc=0} 23:18:02.141540 --- ParallelTerminationStrategy: PID 12163 died... 23:18:02.161112 run iperf3-srv_10.42.42.10(pid=12163): Terminated {rc=256} 23:18:02.205951 --- ParallelTerminationStrategy: PID 12166 died... 23:18:02.225494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12166): Terminated: ok {rc=0} 23:18:02.270804 --- ParallelTerminationStrategy: PID 12169 died... 23:18:02.290410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12169): Terminated: ok {rc=0} 23:18:02.334808 --- ParallelTerminationStrategy: PID 12172 died... 23:18:02.353900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12172): Terminated: ok {rc=0} 23:18:02.440877 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo iperf3m4.py ---------------------------------------------- 23:18:03.595921 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:03.607879 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:18:03.642857 tst iperf3m4.py: using LAC 36913 23:18:03.774327 tst iperf3m4.py: using RAC 193 23:18:03.896761 tst iperf3m4.py: using CellId 36913 23:18:04.019642 tst iperf3m4.py: using BVCI 36914 23:18:04.141598 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:04.152833 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:04.164181 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:04.175245 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:04.186771 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:04.198317 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:04.210453 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:04.221835 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:04.233337 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:18:04.355182 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:18:04.476481 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:18:04.598168 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:18:04.715757 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:18:04.924686 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:05.237784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12174): Launched 23:18:05.509789 run iperf3-srv_10.42.42.10(pid=12175): Launched 23:18:05.626315 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:18:05.835109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:06.148055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12176): Launched 23:18:06.420646 run iperf3-srv_10.42.42.10(pid=12177): Launched 23:18:06.536712 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:18:06.744649 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:07.057141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12178): Launched 23:18:07.327843 run iperf3-srv_10.42.42.10(pid=12179): Launched 23:18:07.444143 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:18:07.651593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:07.964331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12180): Launched 23:18:08.250969 run iperf3-srv_10.42.42.10(pid=12181): Launched 23:18:08.366703 tst iperf3m4.py:8: start network... 23:18:08.575352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:09.058048 run create_hlr_db(pid=12182): Launched 23:18:09.187624 bus /gobi_6: Setting Powered False 23:18:10.253873 run create_hlr_db(pid=12182): Terminated: ok {rc=0} 23:18:10.718954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12184): Launched 23:18:11.053093 run osmo-hlr_10.42.42.2(pid=12185): Launched 23:18:11.179859 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:11.755615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12187): Launched 23:18:12.088537 run osmo-stp_10.42.42.5(pid=12188): Launched 23:18:12.214994 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:12.788392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12190): Launched 23:18:12.914945 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:13.197889 run patchelf(pid=12191): Launched 23:18:13.382238 run osmo-stp_10.42.42.5(pid=12188): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12188)] 23:18:13.523777 run osmo-stp_10.42.42.5(pid=12188): stdout: | (launched: 2022-12-13_23:18:12.026117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:13.665982 run osmo-stp_10.42.42.5(pid=12188): stderr: | [0;m[38;5;43m20221213231812219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231812219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231812220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231812220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231812221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231812221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231812221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:13.808403 run osmo-stp_10.42.42.5(pid=12188): stdout: | (launched: 2022-12-13_23:18:12.026117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:13.944086 run osmo-stp_10.42.42.5(pid=12188): stderr: | [0;m[38;5;43m20221213231812219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231812219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231812220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231812220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231812221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231812221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231812221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:14.105790 run patchelf(pid=12191): Terminating (SIGINT) 23:18:14.291182 run patchelf(pid=12191): Terminated: ok {rc=0} 23:18:14.425050 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12188): Process ended prematurely: osmo-stp_10.42.42.5(pid=12188) [trial-2396↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12188)] [trial-2396↪gprs:sysmo↪iperf3m4.py:8] 23:18:14.435282 tst iperf3m4.py:8: Test FAILED (10.9 sec) 23:18:14.464121 run osmo-hlr_10.42.42.2(pid=12185): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12185)] 23:18:14.515520 run osmo-hlr_10.42.42.2(pid=12185): stdout: | (launched: 2022-12-13_23:18:10.990917) 23:18:14.567760 run osmo-hlr_10.42.42.2(pid=12185): stderr: | [0;m[1;31m20221213231811191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231811191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231811191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231811191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231811191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231811191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231811210 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231811219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231811220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231811220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:14.620635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12174): Terminating (SIGTERM) 23:18:14.663453 run iperf3-srv_10.42.42.10(pid=12175): Terminating (SIGTERM) 23:18:14.706234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12176): Terminating (SIGTERM) 23:18:14.748579 run iperf3-srv_10.42.42.10(pid=12177): Terminating (SIGTERM) 23:18:14.791112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12178): Terminating (SIGTERM) 23:18:14.833795 run iperf3-srv_10.42.42.10(pid=12179): Terminating (SIGTERM) 23:18:14.876107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12180): Terminating (SIGTERM) 23:18:14.918438 run iperf3-srv_10.42.42.10(pid=12181): Terminating (SIGTERM) 23:18:14.960917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12184): Terminating (SIGTERM) 23:18:15.003800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12187): Terminating (SIGTERM) 23:18:15.046157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12190): Terminating (SIGTERM) 23:18:15.089024 --- ParallelTerminationStrategy: PID 12174 died... 23:18:15.109653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12174): Terminated: ok {rc=0} 23:18:15.156780 --- ParallelTerminationStrategy: PID 12175 died... 23:18:15.177535 run iperf3-srv_10.42.42.10(pid=12175): Terminated {rc=256} 23:18:15.224668 --- ParallelTerminationStrategy: PID 12176 died... 23:18:15.245098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12176): Terminated: ok {rc=0} 23:18:15.292119 --- ParallelTerminationStrategy: PID 12177 died... 23:18:15.312468 run iperf3-srv_10.42.42.10(pid=12177): Terminated {rc=256} 23:18:15.359585 --- ParallelTerminationStrategy: PID 12178 died... 23:18:15.379867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12178): Terminated: ok {rc=0} 23:18:15.427640 --- ParallelTerminationStrategy: PID 12179 died... 23:18:15.447802 run iperf3-srv_10.42.42.10(pid=12179): Terminated {rc=256} 23:18:15.494810 --- ParallelTerminationStrategy: PID 12180 died... 23:18:15.515105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12180): Terminated: ok {rc=0} 23:18:15.562146 --- ParallelTerminationStrategy: PID 12181 died... 23:18:15.582342 run iperf3-srv_10.42.42.10(pid=12181): Terminated {rc=256} 23:18:15.629551 --- ParallelTerminationStrategy: PID 12184 died... 23:18:15.649719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12184): Terminated: ok {rc=0} 23:18:15.696851 --- ParallelTerminationStrategy: PID 12187 died... 23:18:15.717748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12187): Terminated: ok {rc=0} 23:18:15.764919 --- ParallelTerminationStrategy: PID 12190 died... 23:18:15.785315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12190): Terminated: ok {rc=0} 23:18:15.890687 bus /gobi_4: Setting Powered False 23:18:17.009438 bus /gobi_4: Setting Powered False 23:18:18.136434 bus /gobi_1: Setting Powered False 23:18:19.235955 bus /gobi_1: Setting Powered False 23:18:20.351507 bus /gobi_0: Setting Powered False 23:18:21.452086 bus /gobi_0: Setting Powered False 23:18:22.566688 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo ping.py ---------------------------------------------- 23:18:23.670442 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:23.682752 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:18:23.722727 tst ping.py: using LAC 36914 23:18:23.851795 tst ping.py: using RAC 194 23:18:23.979227 tst ping.py: using CellId 36914 23:18:24.105328 tst ping.py: using BVCI 36915 23:18:24.225170 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:24.236461 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:24.247645 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:24.258682 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:24.270080 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:24.281475 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:24.292832 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:24.304217 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:18:24.425373 tst ping.py:19: start network... 23:18:24.646569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:25.155562 run create_hlr_db(pid=12192): Launched 23:18:25.280086 bus /gobi_6: Setting Powered False 23:18:26.344275 run create_hlr_db(pid=12192): Terminated: ok {rc=0} 23:18:26.801308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12194): Launched 23:18:27.129617 run osmo-hlr_10.42.42.2(pid=12195): Launched 23:18:27.254879 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:27.820140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12197): Launched 23:18:28.147332 run osmo-stp_10.42.42.5(pid=12198): Launched 23:18:28.271353 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:28.834998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12200): Launched 23:18:28.955355 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:29.214336 run patchelf(pid=12201): Launched 23:18:29.382339 run osmo-stp_10.42.42.5(pid=12198): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12198)] 23:18:29.510801 run osmo-stp_10.42.42.5(pid=12198): stdout: | (launched: 2022-12-13_23:18:28.085716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:29.640671 run osmo-stp_10.42.42.5(pid=12198): stderr: | [0;m[38;5;43m20221213231828280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231828281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231828281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231828281 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231828283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231828284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231828284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:29.770609 run osmo-stp_10.42.42.5(pid=12198): stdout: | (launched: 2022-12-13_23:18:28.085716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:29.895857 run osmo-stp_10.42.42.5(pid=12198): stderr: | [0;m[38;5;43m20221213231828280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231828281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231828281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231828281 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231828283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231828284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231828284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:30.043201 run patchelf(pid=12201): Terminating (SIGINT) 23:18:30.212864 run patchelf(pid=12201): Terminated: ok {rc=0} 23:18:30.335161 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12198): Process ended prematurely: osmo-stp_10.42.42.5(pid=12198) [trial-2396↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12198)] [trial-2396↪gprs:sysmo↪ping.py:22] 23:18:30.343858 tst ping.py:22: Test FAILED (6.7 sec) 23:18:30.370473 run osmo-hlr_10.42.42.2(pid=12195): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12195)] 23:18:30.418792 run osmo-hlr_10.42.42.2(pid=12195): stdout: | (launched: 2022-12-13_23:18:27.068066) 23:18:30.468348 run osmo-hlr_10.42.42.2(pid=12195): stderr: | [0;m[1;31m20221213231827268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231827268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231827268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231827268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231827268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231827268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231827282 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231827290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231827291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231827291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:30.518410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12194): Terminating (SIGTERM) 23:18:30.558668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12197): Terminating (SIGTERM) 23:18:30.598842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12200): Terminating (SIGTERM) 23:18:30.639180 --- ParallelTerminationStrategy: PID 12194 died... 23:18:30.658534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12194): Terminated: ok {rc=0} 23:18:30.702836 --- ParallelTerminationStrategy: PID 12197 died... 23:18:30.721642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12197): Terminated: ok {rc=0} 23:18:30.765774 --- ParallelTerminationStrategy: PID 12200 died... 23:18:30.784316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12200): Terminated: ok {rc=0} 23:18:30.883118 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 23:18:31.990224 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:32.010682 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:18:32.053843 tst ping_idle_ping.py: using LAC 36915 23:18:32.187895 tst ping_idle_ping.py: using RAC 195 23:18:32.325118 tst ping_idle_ping.py: using CellId 36915 23:18:32.454905 tst ping_idle_ping.py: using BVCI 36916 23:18:32.567077 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:32.577782 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:32.588328 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:32.598765 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:32.609145 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:32.619848 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:32.631112 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:32.641691 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:18:32.765423 tst ping_idle_ping.py:24: start network... 23:18:32.970619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:33.443646 run create_hlr_db(pid=12203): Launched 23:18:33.568174 bus /gobi_6: Setting Powered False 23:18:34.629434 run create_hlr_db(pid=12203): Terminated: ok {rc=0} 23:18:35.057076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12205): Launched 23:18:35.363613 run osmo-hlr_10.42.42.2(pid=12206): Launched 23:18:35.479444 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:36.022067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12208): Launched 23:18:36.327123 run osmo-stp_10.42.42.5(pid=12209): Launched 23:18:36.442706 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:36.970872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12211): Launched 23:18:37.087191 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:37.347071 run patchelf(pid=12212): Launched 23:18:37.516246 run osmo-stp_10.42.42.5(pid=12209): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12209)] 23:18:37.644936 run osmo-stp_10.42.42.5(pid=12209): stdout: | (launched: 2022-12-13_23:18:36.269426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:37.775789 run osmo-stp_10.42.42.5(pid=12209): stderr: | [0;m[38;5;43m20221213231836442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231836442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231836442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231836443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231836445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231836445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231836445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:37.906355 run osmo-stp_10.42.42.5(pid=12209): stdout: | (launched: 2022-12-13_23:18:36.269426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:38.032104 run osmo-stp_10.42.42.5(pid=12209): stderr: | [0;m[38;5;43m20221213231836442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231836442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231836442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231836443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231836445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231836445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231836445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:38.180110 run patchelf(pid=12212): Terminating (SIGINT) 23:18:38.350631 run patchelf(pid=12212): Terminated: ok {rc=0} 23:18:38.473511 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12209): Process ended prematurely: osmo-stp_10.42.42.5(pid=12209) [trial-2396↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12209)] [trial-2396↪gprs:sysmo↪ping_idle_ping.py:27] 23:18:38.482183 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:18:38.508714 run osmo-hlr_10.42.42.2(pid=12206): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12206)] 23:18:38.556352 run osmo-hlr_10.42.42.2(pid=12206): stdout: | (launched: 2022-12-13_23:18:35.305775) 23:18:38.605588 run osmo-hlr_10.42.42.2(pid=12206): stderr: | [0;m[1;31m20221213231835487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231835487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231835487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231835487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231835487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231835487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231835499 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231835510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231835510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231835510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:38.655183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12205): Terminating (SIGTERM) 23:18:38.694712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12208): Terminating (SIGTERM) 23:18:38.734094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12211): Terminating (SIGTERM) 23:18:38.773758 --- ParallelTerminationStrategy: PID 12205 died... 23:18:38.792318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12205): Terminated: ok {rc=0} 23:18:38.836030 --- ParallelTerminationStrategy: PID 12208 died... 23:18:38.854660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12208): Terminated: ok {rc=0} 23:18:38.898259 --- ParallelTerminationStrategy: PID 12211 died... 23:18:38.916606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12211): Terminated: ok {rc=0} 23:18:39.000131 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 23:18:40.291479 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:18:40.297754 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:18:40.319733 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:18:40.360891 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:18:40.450257 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:18:40.471572 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:18:40.511308 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:18:41.106998 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:18:41.161325 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:41.172442 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:18:41.209430 tst cs_paging_gprs_active.py: using LAC 36916 23:18:41.333244 tst cs_paging_gprs_active.py: using RAC 196 23:18:41.456719 tst cs_paging_gprs_active.py: using CellId 36916 23:18:41.580802 tst cs_paging_gprs_active.py: using BVCI 36917 23:18:41.695254 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:41.706390 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:41.717237 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:41.727958 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:41.738592 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:41.749858 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:41.760684 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:41.771391 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:41.782437 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:41.905667 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:42.023624 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:18:42.233923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:42.548437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12216): Launched 23:18:42.822181 run iperf3-srv_10.42.42.10(pid=12217): Launched 23:18:42.939238 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:18:43.148807 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:43.463057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12218): Launched 23:18:43.734700 run iperf3-srv_10.42.42.10(pid=12219): Launched 23:18:43.850788 tst cs_paging_gprs_active.py:38: start network... 23:18:44.059454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:44.541469 run create_hlr_db(pid=12220): Launched 23:18:44.668250 bus /gobi_6: Setting Powered False 23:18:45.730246 run create_hlr_db(pid=12220): Terminated: ok {rc=0} 23:18:46.276842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12222): Launched 23:18:46.645109 run osmo-hlr_10.42.42.2(pid=12223): Launched 23:18:46.845537 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:47.527108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12225): Launched 23:18:47.861664 run osmo-stp_10.42.42.5(pid=12226): Launched 23:18:47.988456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:48.563122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12228): Launched 23:18:48.690793 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:48.973092 run patchelf(pid=12229): Launched 23:18:49.157238 run osmo-stp_10.42.42.5(pid=12226): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12226)] 23:18:49.297729 run osmo-stp_10.42.42.5(pid=12226): stdout: | (launched: 2022-12-13_23:18:47.799317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:49.440619 run osmo-stp_10.42.42.5(pid=12226): stderr: | [0;m[38;5;43m20221213231847996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231847997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231847997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231847997 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231847998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231847998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231847998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:49.583536 run osmo-stp_10.42.42.5(pid=12226): stdout: | (launched: 2022-12-13_23:18:47.799317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:49.720215 run osmo-stp_10.42.42.5(pid=12226): stderr: | [0;m[38;5;43m20221213231847996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231847997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231847997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231847997 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231847998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231847998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231847998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:49.882157 run patchelf(pid=12229): Terminating (SIGINT) 23:18:50.068142 run patchelf(pid=12229): Terminated: ok {rc=0} 23:18:50.202321 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12226): Process ended prematurely: osmo-stp_10.42.42.5(pid=12226) [trial-2396↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12226)] [trial-2396↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:18:50.212876 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 23:18:50.241731 run osmo-hlr_10.42.42.2(pid=12223): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12223)] 23:18:50.293242 run osmo-hlr_10.42.42.2(pid=12223): stdout: | (launched: 2022-12-13_23:18:46.580263) 23:18:50.346335 run osmo-hlr_10.42.42.2(pid=12223): stderr: | [0;m[1;31m20221213231846948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231846948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231846949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231846949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231846949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231846953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231846976 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231846994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231846994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231846994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:50.399166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12216): Terminating (SIGTERM) 23:18:50.441630 run iperf3-srv_10.42.42.10(pid=12217): Terminating (SIGTERM) 23:18:50.483921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12218): Terminating (SIGTERM) 23:18:50.527014 run iperf3-srv_10.42.42.10(pid=12219): Terminating (SIGTERM) 23:18:50.569416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12222): Terminating (SIGTERM) 23:18:50.611939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12225): Terminating (SIGTERM) 23:18:50.654497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12228): Terminating (SIGTERM) 23:18:50.697179 --- ParallelTerminationStrategy: PID 12216 died... 23:18:50.717556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12216): Terminated: ok {rc=0} 23:18:50.764179 --- ParallelTerminationStrategy: PID 12217 died... 23:18:50.783911 run iperf3-srv_10.42.42.10(pid=12217): Terminated {rc=256} 23:18:50.829913 --- ParallelTerminationStrategy: PID 12218 died... 23:18:50.849799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12218): Terminated: ok {rc=0} 23:18:50.895905 --- ParallelTerminationStrategy: PID 12219 died... 23:18:50.915661 run iperf3-srv_10.42.42.10(pid=12219): Terminated {rc=256} 23:18:50.961488 --- ParallelTerminationStrategy: PID 12222 died... 23:18:50.981228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12222): Terminated: ok {rc=0} 23:18:51.027361 --- ParallelTerminationStrategy: PID 12225 died... 23:18:51.046994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12225): Terminated: ok {rc=0} 23:18:51.093277 --- ParallelTerminationStrategy: PID 12228 died... 23:18:51.112877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12228): Terminated: ok {rc=0} 23:18:51.201482 bus /gobi_0: Setting Powered False 23:18:52.300187 bus /gobi_0: Setting Powered False 23:18:53.417957 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:18:54.569055 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:54.581101 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:18:54.618900 tst iperf3.py: using LAC 36917 23:18:54.750974 tst iperf3.py: using RAC 197 23:18:54.881764 tst iperf3.py: using CellId 36917 23:18:55.005458 tst iperf3.py: using BVCI 36918 23:18:55.118219 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:55.129268 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:55.140195 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:55.150994 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:55.162026 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:55.172757 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:55.183745 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:55.194714 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:55.205672 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:55.329831 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:18:55.539413 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:55.852020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12230): Launched 23:18:56.124533 run iperf3-srv_10.42.42.10(pid=12231): Launched 23:18:56.240681 tst iperf3.py:8: start network... 23:18:56.448273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:56.929628 run create_hlr_db(pid=12232): Launched 23:18:57.056136 bus /gobi_6: Setting Powered False 23:18:58.117751 run create_hlr_db(pid=12232): Terminated: ok {rc=0} 23:18:58.571748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12234): Launched 23:18:58.905940 run osmo-hlr_10.42.42.2(pid=12235): Launched 23:18:59.032102 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:59.606005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12237): Launched 23:18:59.938819 run osmo-stp_10.42.42.5(pid=12238): Launched 23:19:00.065111 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:00.640690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12240): Launched 23:19:00.767430 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:01.061833 run patchelf(pid=12241): Launched 23:19:01.250164 run osmo-stp_10.42.42.5(pid=12238): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12238)] 23:19:01.393703 run osmo-stp_10.42.42.5(pid=12238): stdout: | (launched: 2022-12-13_23:18:59.876342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:01.539432 run osmo-stp_10.42.42.5(pid=12238): stderr: | [0;m[38;5;43m20221213231900074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231900074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231900074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231900075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231900075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231900075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231900075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:01.686625 run osmo-stp_10.42.42.5(pid=12238): stdout: | (launched: 2022-12-13_23:18:59.876342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:01.825834 run osmo-stp_10.42.42.5(pid=12238): stderr: | [0;m[38;5;43m20221213231900074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231900074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231900074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231900075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231900075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231900075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231900075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:01.990752 run patchelf(pid=12241): Terminating (SIGINT) 23:19:02.181132 run patchelf(pid=12241): Terminated: ok {rc=0} 23:19:02.315307 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12238): Process ended prematurely: osmo-stp_10.42.42.5(pid=12238) [trial-2396↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12238)] [trial-2396↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 23:19:02.325521 tst iperf3.py:8: Test FAILED (7.8 sec) 23:19:02.354220 run osmo-hlr_10.42.42.2(pid=12235): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12235)] 23:19:02.405803 run osmo-hlr_10.42.42.2(pid=12235): stdout: | (launched: 2022-12-13_23:18:58.843564) 23:19:02.459359 run osmo-hlr_10.42.42.2(pid=12235): stderr: | [0;m[1;31m20221213231859046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231859046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231859046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231859046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231859046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231859046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231859059 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231859069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231859070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231859070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:02.513400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12230): Terminating (SIGTERM) 23:19:02.556494 run iperf3-srv_10.42.42.10(pid=12231): Terminating (SIGTERM) 23:19:02.599482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12234): Terminating (SIGTERM) 23:19:02.642752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12237): Terminating (SIGTERM) 23:19:02.685695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12240): Terminating (SIGTERM) 23:19:02.728803 --- ParallelTerminationStrategy: PID 12230 died... 23:19:02.749582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12230): Terminated: ok {rc=0} 23:19:02.796703 --- ParallelTerminationStrategy: PID 12231 died... 23:19:02.816758 run iperf3-srv_10.42.42.10(pid=12231): Terminated {rc=256} 23:19:02.863642 --- ParallelTerminationStrategy: PID 12234 died... 23:19:02.883911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12234): Terminated: ok {rc=0} 23:19:02.931433 --- ParallelTerminationStrategy: PID 12237 died... 23:19:02.951807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12237): Terminated: ok {rc=0} 23:19:02.999360 --- ParallelTerminationStrategy: PID 12240 died... 23:19:03.019497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12240): Terminated: ok {rc=0} 23:19:03.109017 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:19:04.258190 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:04.269940 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:19:04.307302 tst iperf3m4.py: using LAC 36918 23:19:04.437658 tst iperf3m4.py: using RAC 198 23:19:04.569368 tst iperf3m4.py: using CellId 36918 23:19:04.701895 tst iperf3m4.py: using BVCI 36919 23:19:04.823701 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:04.835226 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:04.846482 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:04.857600 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:04.868927 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:04.880385 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:04.892011 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:04.903343 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:04.914917 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:19:05.033178 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:19:05.156384 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:19:05.274730 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:19:05.393324 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:19:05.603145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:05.917924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12242): Launched 23:19:06.190219 run iperf3-srv_10.42.42.10(pid=12243): Launched 23:19:06.306705 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:19:06.515053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:06.828828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12244): Launched 23:19:07.099929 run iperf3-srv_10.42.42.10(pid=12245): Launched 23:19:07.216050 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:19:07.423453 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:07.736312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12246): Launched 23:19:08.007340 run iperf3-srv_10.42.42.10(pid=12247): Launched 23:19:08.123506 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:19:08.332256 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:08.644922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12248): Launched 23:19:08.916737 run iperf3-srv_10.42.42.10(pid=12249): Launched 23:19:09.033125 tst iperf3m4.py:8: start network... 23:19:09.241327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:09.722245 run create_hlr_db(pid=12250): Launched 23:19:09.850293 bus /gobi_6: Setting Powered False 23:19:10.911500 run create_hlr_db(pid=12250): Terminated: ok {rc=0} 23:19:11.343647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12252): Launched 23:19:11.655378 run osmo-hlr_10.42.42.2(pid=12253): Launched 23:19:11.772657 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:12.307966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12255): Launched 23:19:12.619731 run osmo-stp_10.42.42.5(pid=12256): Launched 23:19:12.738416 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:13.274017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12258): Launched 23:19:13.391950 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:13.655828 run patchelf(pid=12259): Launched 23:19:13.827374 run osmo-stp_10.42.42.5(pid=12256): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12256)] 23:19:13.958360 run osmo-stp_10.42.42.5(pid=12256): stdout: | (launched: 2022-12-13_23:19:12.560753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:14.091167 run osmo-stp_10.42.42.5(pid=12256): stderr: | [0;m[38;5;43m20221213231912735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231912736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231912736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231912736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231912739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231912739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231912739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:14.223835 run osmo-stp_10.42.42.5(pid=12256): stdout: | (launched: 2022-12-13_23:19:12.560753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:14.350155 run osmo-stp_10.42.42.5(pid=12256): stderr: | [0;m[38;5;43m20221213231912735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231912736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231912736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231912736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231912739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231912739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231912739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:14.499998 run patchelf(pid=12259): Terminating (SIGINT) 23:19:14.673207 run patchelf(pid=12259): Terminated: ok {rc=0} 23:19:14.797806 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12256): Process ended prematurely: osmo-stp_10.42.42.5(pid=12256) [trial-2396↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12256)] [trial-2396↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 23:19:14.807134 tst iperf3m4.py:8: Test FAILED (10.6 sec) 23:19:14.834626 run osmo-hlr_10.42.42.2(pid=12253): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12253)] 23:19:14.882165 run osmo-hlr_10.42.42.2(pid=12253): stdout: | (launched: 2022-12-13_23:19:11.596366) 23:19:14.931489 run osmo-hlr_10.42.42.2(pid=12253): stderr: | [0;m[1;31m20221213231911778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231911778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231911778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231911778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231911778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231911778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231911790 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231911799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231911799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231911799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:14.981481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12242): Terminating (SIGTERM) 23:19:15.021163 run iperf3-srv_10.42.42.10(pid=12243): Terminating (SIGTERM) 23:19:15.060803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12244): Terminating (SIGTERM) 23:19:15.100209 run iperf3-srv_10.42.42.10(pid=12245): Terminating (SIGTERM) 23:19:15.139608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12246): Terminating (SIGTERM) 23:19:15.179104 run iperf3-srv_10.42.42.10(pid=12247): Terminating (SIGTERM) 23:19:15.218550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12248): Terminating (SIGTERM) 23:19:15.258064 run iperf3-srv_10.42.42.10(pid=12249): Terminating (SIGTERM) 23:19:15.297465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12252): Terminating (SIGTERM) 23:19:15.337649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12255): Terminating (SIGTERM) 23:19:15.377228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12258): Terminating (SIGTERM) 23:19:15.417109 --- ParallelTerminationStrategy: PID 12242 died... 23:19:15.436266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12242): Terminated: ok {rc=0} 23:19:15.480596 --- ParallelTerminationStrategy: PID 12243 died... 23:19:15.499202 run iperf3-srv_10.42.42.10(pid=12243): Terminated {rc=256} 23:19:15.542743 --- ParallelTerminationStrategy: PID 12244 died... 23:19:15.561437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12244): Terminated: ok {rc=0} 23:19:15.605427 --- ParallelTerminationStrategy: PID 12245 died... 23:19:15.624150 run iperf3-srv_10.42.42.10(pid=12245): Terminated {rc=256} 23:19:15.667790 --- ParallelTerminationStrategy: PID 12246 died... 23:19:15.686372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12246): Terminated: ok {rc=0} 23:19:15.730019 --- ParallelTerminationStrategy: PID 12247 died... 23:19:15.748392 run iperf3-srv_10.42.42.10(pid=12247): Terminated {rc=256} 23:19:15.792512 --- ParallelTerminationStrategy: PID 12248 died... 23:19:15.811142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12248): Terminated: ok {rc=0} 23:19:15.882401 --- ParallelTerminationStrategy: PID 12249 died... 23:19:15.910942 run iperf3-srv_10.42.42.10(pid=12249): Terminated {rc=256} 23:19:15.970827 --- ParallelTerminationStrategy: PID 12252 died... 23:19:15.992539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12252): Terminated: ok {rc=0} 23:19:16.042335 --- ParallelTerminationStrategy: PID 12255 died... 23:19:16.064372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12255): Terminated: ok {rc=0} 23:19:16.115840 --- ParallelTerminationStrategy: PID 12258 died... 23:19:16.137896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12258): Terminated: ok {rc=0} 23:19:16.233854 bus /gobi_4: Setting Powered False 23:19:17.337986 bus /gobi_4: Setting Powered False 23:19:18.455319 bus /gobi_1: Setting Powered False 23:19:19.555490 bus /gobi_1: Setting Powered False 23:19:20.672396 bus /gobi_0: Setting Powered False 23:19:21.772620 bus /gobi_0: Setting Powered False 23:19:22.889305 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 23:19:23.993070 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:24.004702 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:19:24.043054 tst ping.py: using LAC 36919 23:19:24.164784 tst ping.py: using RAC 199 23:19:24.285780 tst ping.py: using CellId 36919 23:19:24.406233 tst ping.py: using BVCI 36920 23:19:24.518439 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:24.529341 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:24.540137 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:24.550850 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:24.561619 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:24.572421 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:24.583466 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:24.594425 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:19:24.715808 tst ping.py:19: start network... 23:19:24.936774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:25.445613 run create_hlr_db(pid=12260): Launched 23:19:25.570546 bus /gobi_6: Setting Powered False 23:19:26.634900 run create_hlr_db(pid=12260): Terminated: ok {rc=0} 23:19:27.091300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12262): Launched 23:19:27.418723 run osmo-hlr_10.42.42.2(pid=12263): Launched 23:19:27.547521 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:28.114290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12265): Launched 23:19:28.442320 run osmo-stp_10.42.42.5(pid=12266): Launched 23:19:28.567318 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:29.130275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12268): Launched 23:19:29.254932 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:29.532606 run patchelf(pid=12269): Launched 23:19:29.713446 run osmo-stp_10.42.42.5(pid=12266): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12266)] 23:19:29.851104 run osmo-stp_10.42.42.5(pid=12266): stdout: | (launched: 2022-12-13_23:19:28.380485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:29.990906 run osmo-stp_10.42.42.5(pid=12266): stderr: | [0;m[38;5;43m20221213231928576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231928576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231928576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231928577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231928577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231928577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231928578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:30.130809 run osmo-stp_10.42.42.5(pid=12266): stdout: | (launched: 2022-12-13_23:19:28.380485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:30.264692 run osmo-stp_10.42.42.5(pid=12266): stderr: | [0;m[38;5;43m20221213231928576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231928576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231928576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231928577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231928577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231928577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231928578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:30.423548 run patchelf(pid=12269): Terminating (SIGINT) 23:19:30.606242 run patchelf(pid=12269): Terminated: ok {rc=0} 23:19:30.737817 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12266): Process ended prematurely: osmo-stp_10.42.42.5(pid=12266) [trial-2396↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12266)] [trial-2396↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 23:19:30.747362 tst ping.py:22: Test FAILED (6.7 sec) 23:19:30.775714 run osmo-hlr_10.42.42.2(pid=12263): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12263)] 23:19:30.826799 run osmo-hlr_10.42.42.2(pid=12263): stdout: | (launched: 2022-12-13_23:19:27.357238) 23:19:30.899180 run osmo-hlr_10.42.42.2(pid=12263): stderr: | [0;m[1;31m20221213231927557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231927557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231927557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231927557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231927557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231927557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231927569 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231927578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231927578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231927578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:30.956450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12262): Terminating (SIGTERM) 23:19:30.998326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12265): Terminating (SIGTERM) 23:19:31.043639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12268): Terminating (SIGTERM) 23:19:31.087884 --- ParallelTerminationStrategy: PID 12262 died... 23:19:31.109545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12262): Terminated: ok {rc=0} 23:19:31.158279 --- ParallelTerminationStrategy: PID 12265 died... 23:19:31.179791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12265): Terminated: ok {rc=0} 23:19:31.228263 --- ParallelTerminationStrategy: PID 12268 died... 23:19:31.249688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12268): Terminated: ok {rc=0} 23:19:31.341664 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:19:32.430299 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:32.442052 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:19:32.480134 tst ping_idle_ping.py: using LAC 36920 23:19:32.601474 tst ping_idle_ping.py: using RAC 200 23:19:32.725131 tst ping_idle_ping.py: using CellId 36920 23:19:32.845420 tst ping_idle_ping.py: using BVCI 36921 23:19:32.959206 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:32.970086 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:32.980832 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:32.991551 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:33.002745 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:33.013928 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:33.025315 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:33.036426 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:19:33.161096 tst ping_idle_ping.py:24: start network... 23:19:33.367056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:33.841623 run create_hlr_db(pid=12270): Launched 23:19:33.965919 bus /gobi_6: Setting Powered False 23:19:35.026943 run create_hlr_db(pid=12270): Terminated: ok {rc=0} 23:19:35.477596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12272): Launched 23:19:35.807648 run osmo-hlr_10.42.42.2(pid=12273): Launched 23:19:35.935344 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:36.502901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12275): Launched 23:19:36.814641 run osmo-stp_10.42.42.5(pid=12276): Launched 23:19:36.930352 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:37.459156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12278): Launched 23:19:37.575926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:37.835498 run patchelf(pid=12279): Launched 23:19:38.004681 run osmo-stp_10.42.42.5(pid=12276): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12276)] 23:19:38.133233 run osmo-stp_10.42.42.5(pid=12276): stdout: | (launched: 2022-12-13_23:19:36.756569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:38.263154 run osmo-stp_10.42.42.5(pid=12276): stderr: | [0;m[38;5;43m20221213231936931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231936931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231936931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231936931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231936932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231936932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231936932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:38.393228 run osmo-stp_10.42.42.5(pid=12276): stdout: | (launched: 2022-12-13_23:19:36.756569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:38.518621 run osmo-stp_10.42.42.5(pid=12276): stderr: | [0;m[38;5;43m20221213231936931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231936931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231936931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231936931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231936932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231936932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231936932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:38.666462 run patchelf(pid=12279): Terminating (SIGINT) 23:19:38.836536 run patchelf(pid=12279): Terminated: ok {rc=0} 23:19:38.959442 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12276): Process ended prematurely: osmo-stp_10.42.42.5(pid=12276) [trial-2396↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12276)] [trial-2396↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 23:19:38.968396 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:19:38.994893 run osmo-hlr_10.42.42.2(pid=12273): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12273)] 23:19:39.042476 run osmo-hlr_10.42.42.2(pid=12273): stdout: | (launched: 2022-12-13_23:19:35.745870) 23:19:39.091707 run osmo-hlr_10.42.42.2(pid=12273): stderr: | [0;m[1;31m20221213231935947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231935948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231935948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231935948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231935948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231935948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231935961 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231935969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231935969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231935969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:39.141663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12272): Terminating (SIGTERM) 23:19:39.181510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12275): Terminating (SIGTERM) 23:19:39.221550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12278): Terminating (SIGTERM) 23:19:39.262011 --- ParallelTerminationStrategy: PID 12272 died... 23:19:39.281683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12272): Terminated: ok {rc=0} 23:19:39.326247 --- ParallelTerminationStrategy: PID 12275 died... 23:19:39.345122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12275): Terminated: ok {rc=0} 23:19:39.389324 --- ParallelTerminationStrategy: PID 12278 died... 23:19:39.408103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12278): Terminated: ok {rc=0} 23:19:39.495366 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:19:40.788794 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:19:40.795554 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:19:40.817146 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:19:40.858051 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:19:40.947843 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:19:40.969472 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:19:41.009565 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:19:41.606557 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:19:41.660733 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:41.672276 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:19:41.733695 tst cs_paging_gprs_active.py: using LAC 36921 23:19:41.863071 tst cs_paging_gprs_active.py: using RAC 201 23:19:41.993674 tst cs_paging_gprs_active.py: using CellId 36921 23:19:42.116279 tst cs_paging_gprs_active.py: using BVCI 36922 23:19:42.229453 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:42.240357 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:42.251286 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:42.262204 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:42.273558 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:42.284884 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:42.296306 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:42.307470 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:42.318839 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:42.441974 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:42.562109 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:19:42.773588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:43.087479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12283): Launched 23:19:43.359243 run iperf3-srv_10.42.42.10(pid=12284): Launched 23:19:43.475329 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:19:43.684020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:43.997524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12285): Launched 23:19:44.268281 run iperf3-srv_10.42.42.10(pid=12286): Launched 23:19:44.384315 tst cs_paging_gprs_active.py:38: start network... 23:19:44.593649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:45.075956 run create_hlr_db(pid=12287): Launched 23:19:45.201725 bus /gobi_6: Setting Powered False 23:19:46.272929 run create_hlr_db(pid=12287): Terminated: ok {rc=0} 23:19:46.720912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12289): Launched 23:19:47.053849 run osmo-hlr_10.42.42.2(pid=12290): Launched 23:19:47.237784 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:47.778309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12292): Launched 23:19:48.089865 run osmo-stp_10.42.42.5(pid=12293): Launched 23:19:48.207462 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:48.743931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12295): Launched 23:19:48.862782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:49.126941 run patchelf(pid=12296): Launched 23:19:49.299163 run osmo-stp_10.42.42.5(pid=12293): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12293)] 23:19:49.429634 run osmo-stp_10.42.42.5(pid=12293): stdout: | (launched: 2022-12-13_23:19:48.030744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:49.562430 run osmo-stp_10.42.42.5(pid=12293): stderr: | [0;m[38;5;43m20221213231948207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231948207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231948207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231948208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231948208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231948208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231948209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:49.695102 run osmo-stp_10.42.42.5(pid=12293): stdout: | (launched: 2022-12-13_23:19:48.030744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:49.821934 run osmo-stp_10.42.42.5(pid=12293): stderr: | [0;m[38;5;43m20221213231948207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213231948207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213231948207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213231948208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213231948208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213231948208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213231948209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:49.972104 run patchelf(pid=12296): Terminating (SIGINT) 23:19:50.145454 run patchelf(pid=12296): Terminated: ok {rc=0} 23:19:50.270048 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12293): Process ended prematurely: osmo-stp_10.42.42.5(pid=12293) [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12293)] [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:19:50.279789 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 23:19:50.307170 run osmo-hlr_10.42.42.2(pid=12290): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12290)] 23:19:50.354723 run osmo-hlr_10.42.42.2(pid=12290): stdout: | (launched: 2022-12-13_23:19:46.991590) 23:19:50.403824 run osmo-hlr_10.42.42.2(pid=12290): stderr: | [0;m[1;31m20221213231947250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231947250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231947250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231947250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231947250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231947250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231947279 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231947289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231947289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231947289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:50.453571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12283): Terminating (SIGTERM) 23:19:50.493163 run iperf3-srv_10.42.42.10(pid=12284): Terminating (SIGTERM) 23:19:50.533042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12285): Terminating (SIGTERM) 23:19:50.572486 run iperf3-srv_10.42.42.10(pid=12286): Terminating (SIGTERM) 23:19:50.611973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12289): Terminating (SIGTERM) 23:19:50.651382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12292): Terminating (SIGTERM) 23:19:50.690800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12295): Terminating (SIGTERM) 23:19:50.730422 --- ParallelTerminationStrategy: PID 12283 died... 23:19:50.749732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12283): Terminated: ok {rc=0} 23:19:50.793711 --- ParallelTerminationStrategy: PID 12284 died... 23:19:50.812255 run iperf3-srv_10.42.42.10(pid=12284): Terminated {rc=256} 23:19:50.855854 --- ParallelTerminationStrategy: PID 12285 died... 23:19:50.874532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12285): Terminated: ok {rc=0} 23:19:50.918124 --- ParallelTerminationStrategy: PID 12286 died... 23:19:50.936608 run iperf3-srv_10.42.42.10(pid=12286): Terminated {rc=256} 23:19:50.980284 --- ParallelTerminationStrategy: PID 12289 died... 23:19:50.999059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12289): Terminated: ok {rc=0} 23:19:51.042691 --- ParallelTerminationStrategy: PID 12292 died... 23:19:51.061369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12292): Terminated: ok {rc=0} 23:19:51.105272 --- ParallelTerminationStrategy: PID 12295 died... 23:19:51.123927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12295): Terminated: ok {rc=0} 23:19:51.207836 bus /gobi_0: Setting Powered False 23:19:52.306524 bus /gobi_0: Setting Powered False 23:19:53.424623 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:19:54.571499 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:54.583295 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:19:54.642874 tst iperf3.py: using LAC 36922 23:19:54.774520 tst iperf3.py: using RAC 202 23:19:54.906055 tst iperf3.py: using CellId 36922 23:19:55.037157 tst iperf3.py: using BVCI 36923 23:19:55.159627 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:55.171314 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:55.182856 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:55.194132 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:55.205636 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:55.217491 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:55.229179 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:55.241079 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:55.252692 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:55.370644 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:19:55.580087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:55.892832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12297): Launched 23:19:56.163796 run iperf3-srv_10.42.42.10(pid=12298): Launched 23:19:56.280293 tst iperf3.py:8: start network... 23:19:56.488236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:56.969728 run create_hlr_db(pid=12299): Launched 23:19:57.097493 bus /gobi_6: Setting Powered False 23:19:58.159407 run create_hlr_db(pid=12299): Terminated: ok {rc=0} 23:19:58.613820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12301): Launched 23:19:58.947174 run osmo-hlr_10.42.42.2(pid=12302): Launched 23:19:59.073939 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:59.648189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12304): Launched 23:19:59.981371 run osmo-stp_10.42.42.5(pid=12305): Launched 23:20:00.108035 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:00.683148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12307): Launched 23:20:00.809923 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:01.099430 run patchelf(pid=12308): Launched 23:20:01.290687 run osmo-stp_10.42.42.5(pid=12305): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12305)] 23:20:01.425072 run osmo-stp_10.42.42.5(pid=12305): stdout: | (launched: 2022-12-13_23:19:59.919161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:01.562856 run osmo-stp_10.42.42.5(pid=12305): stderr: | [0;m[38;5;43m20221213232000113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232000113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232000114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232000114 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232000115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232000115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232000115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:01.700485 run osmo-stp_10.42.42.5(pid=12305): stdout: | (launched: 2022-12-13_23:19:59.919161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:01.836644 run osmo-stp_10.42.42.5(pid=12305): stderr: | [0;m[38;5;43m20221213232000113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232000113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232000114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232000114 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232000115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232000115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232000115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:01.992687 run patchelf(pid=12308): Terminating (SIGINT) 23:20:02.170663 run patchelf(pid=12308): Terminated: ok {rc=0} 23:20:02.297476 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12305): Process ended prematurely: osmo-stp_10.42.42.5(pid=12305) [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12305)] [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 23:20:02.307142 tst iperf3.py:8: Test FAILED (7.8 sec) 23:20:02.334694 run osmo-hlr_10.42.42.2(pid=12302): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12302)] 23:20:02.382861 run osmo-hlr_10.42.42.2(pid=12302): stdout: | (launched: 2022-12-13_23:19:58.885106) 23:20:02.433219 run osmo-hlr_10.42.42.2(pid=12302): stderr: | [0;m[1;31m20221213231959085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213231959086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213231959086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213231959086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213231959086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213231959086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213231959099 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213231959109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213231959109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213231959109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:02.483671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12297): Terminating (SIGTERM) 23:20:02.524027 run iperf3-srv_10.42.42.10(pid=12298): Terminating (SIGTERM) 23:20:02.564179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12301): Terminating (SIGTERM) 23:20:02.604831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12304): Terminating (SIGTERM) 23:20:02.645665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12307): Terminating (SIGTERM) 23:20:02.686150 --- ParallelTerminationStrategy: PID 12297 died... 23:20:02.705717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12297): Terminated: ok {rc=0} 23:20:02.750155 --- ParallelTerminationStrategy: PID 12298 died... 23:20:02.769206 run iperf3-srv_10.42.42.10(pid=12298): Terminated {rc=256} 23:20:02.813568 --- ParallelTerminationStrategy: PID 12301 died... 23:20:02.832757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12301): Terminated: ok {rc=0} 23:20:02.877217 --- ParallelTerminationStrategy: PID 12304 died... 23:20:02.896244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12304): Terminated: ok {rc=0} 23:20:02.940719 --- ParallelTerminationStrategy: PID 12307 died... 23:20:02.959726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12307): Terminated: ok {rc=0} 23:20:03.046548 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:20:04.195015 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:04.206786 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:20:04.263766 tst iperf3m4.py: using LAC 36923 23:20:04.386998 tst iperf3m4.py: using RAC 203 23:20:04.510774 tst iperf3m4.py: using CellId 36923 23:20:04.642667 tst iperf3m4.py: using BVCI 36924 23:20:04.757061 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:04.767963 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:04.778672 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:04.789361 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:04.799919 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:04.811245 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:04.822641 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:04.833508 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:04.844501 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:20:04.962800 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:20:05.087131 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:20:05.210900 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:20:05.333493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:20:05.561201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:05.897960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12312): Launched 23:20:06.191442 run iperf3-srv_10.42.42.10(pid=12313): Launched 23:20:06.316812 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:20:06.543435 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:06.881076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12314): Launched 23:20:07.172321 run iperf3-srv_10.42.42.10(pid=12315): Launched 23:20:07.297306 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:20:07.523196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:07.859605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12316): Launched 23:20:08.151170 run iperf3-srv_10.42.42.10(pid=12317): Launched 23:20:08.276194 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:20:08.502322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:08.839461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12318): Launched 23:20:09.131165 run iperf3-srv_10.42.42.10(pid=12319): Launched 23:20:09.255965 tst iperf3m4.py:8: start network... 23:20:09.481834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:10.000283 run create_hlr_db(pid=12320): Launched 23:20:10.126796 bus /gobi_6: Setting Powered False 23:20:11.191807 run create_hlr_db(pid=12320): Terminated: ok {rc=0} 23:20:11.636478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12322): Launched 23:20:11.950333 run osmo-hlr_10.42.42.2(pid=12323): Launched 23:20:12.068822 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:12.606501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12325): Launched 23:20:12.920120 run osmo-stp_10.42.42.5(pid=12326): Launched 23:20:13.038888 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:13.576429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12328): Launched 23:20:13.694877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:13.958826 run patchelf(pid=12329): Launched 23:20:14.131532 run osmo-stp_10.42.42.5(pid=12326): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12326)] 23:20:14.262448 run osmo-stp_10.42.42.5(pid=12326): stdout: | (launched: 2022-12-13_23:20:12.860830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:14.394953 run osmo-stp_10.42.42.5(pid=12326): stderr: | [0;m[38;5;43m20221213232013035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232013035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232013035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232013036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232013036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232013036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232013036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:14.527655 run osmo-stp_10.42.42.5(pid=12326): stdout: | (launched: 2022-12-13_23:20:12.860830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:14.654208 run osmo-stp_10.42.42.5(pid=12326): stderr: | [0;m[38;5;43m20221213232013035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232013035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232013035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232013036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232013036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232013036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232013036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:14.805524 run patchelf(pid=12329): Terminating (SIGINT) 23:20:14.979294 run patchelf(pid=12329): Terminated: ok {rc=0} 23:20:15.104226 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12326): Process ended prematurely: osmo-stp_10.42.42.5(pid=12326) [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12326)] [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:20:15.113855 tst iperf3m4.py:8: Test FAILED (11.0 sec) 23:20:15.141246 run osmo-hlr_10.42.42.2(pid=12323): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12323)] 23:20:15.188892 run osmo-hlr_10.42.42.2(pid=12323): stdout: | (launched: 2022-12-13_23:20:11.890942) 23:20:15.238169 run osmo-hlr_10.42.42.2(pid=12323): stderr: | [0;m[1;31m20221213232012073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232012073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232012073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232012073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232012073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232012073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232012086 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232012096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232012096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232012096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:15.288016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12312): Terminating (SIGTERM) 23:20:15.327802 run iperf3-srv_10.42.42.10(pid=12313): Terminating (SIGTERM) 23:20:15.368066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12314): Terminating (SIGTERM) 23:20:15.408274 run iperf3-srv_10.42.42.10(pid=12315): Terminating (SIGTERM) 23:20:15.448477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12316): Terminating (SIGTERM) 23:20:15.488616 run iperf3-srv_10.42.42.10(pid=12317): Terminating (SIGTERM) 23:20:15.528679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12318): Terminating (SIGTERM) 23:20:15.568674 run iperf3-srv_10.42.42.10(pid=12319): Terminating (SIGTERM) 23:20:15.608654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12322): Terminating (SIGTERM) 23:20:15.648780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12325): Terminating (SIGTERM) 23:20:15.688940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12328): Terminating (SIGTERM) 23:20:15.729441 --- ParallelTerminationStrategy: PID 12312 died... 23:20:15.748769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12312): Terminated: ok {rc=0} 23:20:15.793566 --- ParallelTerminationStrategy: PID 12313 died... 23:20:15.812463 run iperf3-srv_10.42.42.10(pid=12313): Terminated {rc=256} 23:20:15.857845 --- ParallelTerminationStrategy: PID 12314 died... 23:20:15.877715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12314): Terminated: ok {rc=0} 23:20:15.937429 --- ParallelTerminationStrategy: PID 12315 died... 23:20:15.958791 run iperf3-srv_10.42.42.10(pid=12315): Terminated {rc=256} 23:20:16.008205 --- ParallelTerminationStrategy: PID 12316 died... 23:20:16.028402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12316): Terminated: ok {rc=0} 23:20:16.088405 --- ParallelTerminationStrategy: PID 12317 died... 23:20:16.108014 run iperf3-srv_10.42.42.10(pid=12317): Terminated {rc=256} 23:20:16.153549 --- ParallelTerminationStrategy: PID 12318 died... 23:20:16.173260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12318): Terminated: ok {rc=0} 23:20:16.218906 --- ParallelTerminationStrategy: PID 12319 died... 23:20:16.238688 run iperf3-srv_10.42.42.10(pid=12319): Terminated {rc=256} 23:20:16.283992 --- ParallelTerminationStrategy: PID 12322 died... 23:20:16.303961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12322): Terminated: ok {rc=0} 23:20:16.349581 --- ParallelTerminationStrategy: PID 12325 died... 23:20:16.369252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12325): Terminated: ok {rc=0} 23:20:16.415053 --- ParallelTerminationStrategy: PID 12328 died... 23:20:16.434890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12328): Terminated: ok {rc=0} 23:20:16.523501 bus /gobi_4: Setting Powered False 23:20:17.621782 bus /gobi_4: Setting Powered False 23:20:18.736706 bus /gobi_1: Setting Powered False 23:20:19.836652 bus /gobi_1: Setting Powered False 23:20:20.954949 bus /gobi_0: Setting Powered False 23:20:22.054222 bus /gobi_0: Setting Powered False 23:20:23.173198 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:20:24.278109 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:24.290290 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:20:24.348036 tst ping.py: using LAC 36924 23:20:24.474937 tst ping.py: using RAC 204 23:20:24.594472 tst ping.py: using CellId 36924 23:20:24.714666 tst ping.py: using BVCI 36925 23:20:24.827971 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:24.839231 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:24.850215 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:24.861260 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:24.872084 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:24.883407 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:24.894659 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:24.905711 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:20:25.023921 tst ping.py:19: start network... 23:20:25.229474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:25.705363 run create_hlr_db(pid=12330): Launched 23:20:25.829692 bus /gobi_6: Setting Powered False 23:20:26.890386 run create_hlr_db(pid=12330): Terminated: ok {rc=0} 23:20:27.341403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12332): Launched 23:20:27.671588 run osmo-hlr_10.42.42.2(pid=12333): Launched 23:20:27.796433 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:28.368679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12335): Launched 23:20:28.696696 run osmo-stp_10.42.42.5(pid=12336): Launched 23:20:28.822588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:29.386648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12338): Launched 23:20:29.511681 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:29.790220 run patchelf(pid=12339): Launched 23:20:29.971428 run osmo-stp_10.42.42.5(pid=12336): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12336)] 23:20:30.109847 run osmo-stp_10.42.42.5(pid=12336): stdout: | (launched: 2022-12-13_23:20:28.635577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:30.249492 run osmo-stp_10.42.42.5(pid=12336): stderr: | [0;m[38;5;43m20221213232028834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232028834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232028834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232028834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232028835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232028835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232028835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:30.388456 run osmo-stp_10.42.42.5(pid=12336): stdout: | (launched: 2022-12-13_23:20:28.635577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:30.522606 run osmo-stp_10.42.42.5(pid=12336): stderr: | [0;m[38;5;43m20221213232028834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232028834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232028834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232028834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232028835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232028835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232028835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:30.681150 run patchelf(pid=12339): Terminating (SIGINT) 23:20:30.898551 run patchelf(pid=12339): Terminated: ok {rc=0} 23:20:31.032262 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12336): Process ended prematurely: osmo-stp_10.42.42.5(pid=12336) [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12336)] [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 23:20:31.042796 tst ping.py:22: Test FAILED (6.8 sec) 23:20:31.072054 run osmo-hlr_10.42.42.2(pid=12333): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12333)] 23:20:31.126842 run osmo-hlr_10.42.42.2(pid=12333): stdout: | (launched: 2022-12-13_23:20:27.609762) 23:20:31.181361 run osmo-hlr_10.42.42.2(pid=12333): stderr: | [0;m[1;31m20221213232027812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232027812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232027813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232027813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232027813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232027813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232027825 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232027833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232027833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232027833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:31.236022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12332): Terminating (SIGTERM) 23:20:31.279328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12335): Terminating (SIGTERM) 23:20:31.324124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12338): Terminating (SIGTERM) 23:20:31.370871 --- ParallelTerminationStrategy: PID 12332 died... 23:20:31.392940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12332): Terminated: ok {rc=0} 23:20:31.442755 --- ParallelTerminationStrategy: PID 12335 died... 23:20:31.464433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12335): Terminated: ok {rc=0} 23:20:31.513379 --- ParallelTerminationStrategy: PID 12338 died... 23:20:31.534975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12338): Terminated: ok {rc=0} 23:20:31.627183 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:20:32.715806 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:32.727611 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:20:32.785772 tst ping_idle_ping.py: using LAC 36925 23:20:32.911655 tst ping_idle_ping.py: using RAC 205 23:20:33.030769 tst ping_idle_ping.py: using CellId 36925 23:20:33.150282 tst ping_idle_ping.py: using BVCI 36926 23:20:33.262330 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:33.273536 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:33.284488 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:33.295422 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:33.306592 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:33.317531 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:33.328724 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:33.340103 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:20:33.455413 tst ping_idle_ping.py:24: start network... 23:20:33.660648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:34.138310 run create_hlr_db(pid=12340): Launched 23:20:34.263535 bus /gobi_6: Setting Powered False 23:20:35.325501 run create_hlr_db(pid=12340): Terminated: ok {rc=0} 23:20:35.777499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12342): Launched 23:20:36.108005 run osmo-hlr_10.42.42.2(pid=12343): Launched 23:20:36.233395 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:36.802270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12345): Launched 23:20:37.133265 run osmo-stp_10.42.42.5(pid=12347): Launched 23:20:37.259243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:37.828429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12349): Launched 23:20:37.954060 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:38.233173 run patchelf(pid=12350): Launched 23:20:38.415283 run osmo-stp_10.42.42.5(pid=12347): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12347)] 23:20:38.554461 run osmo-stp_10.42.42.5(pid=12347): stdout: | (launched: 2022-12-13_23:20:37.071331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:38.695041 run osmo-stp_10.42.42.5(pid=12347): stderr: | [0;m[38;5;43m20221213232037265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232037265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232037266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232037266 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232037266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232037267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232037267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:38.835224 run osmo-stp_10.42.42.5(pid=12347): stdout: | (launched: 2022-12-13_23:20:37.071331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:38.970077 run osmo-stp_10.42.42.5(pid=12347): stderr: | [0;m[38;5;43m20221213232037265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232037265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232037266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232037266 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232037266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232037267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232037267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:39.129314 run patchelf(pid=12350): Terminating (SIGINT) 23:20:39.312630 run patchelf(pid=12350): Terminated: ok {rc=0} 23:20:39.444555 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12347): Process ended prematurely: osmo-stp_10.42.42.5(pid=12347) [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12347)] [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:20:39.454238 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 23:20:39.482522 run osmo-hlr_10.42.42.2(pid=12343): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12343)] 23:20:39.534066 run osmo-hlr_10.42.42.2(pid=12343): stdout: | (launched: 2022-12-13_23:20:36.045913) 23:20:39.587333 run osmo-hlr_10.42.42.2(pid=12343): stderr: | [0;m[1;31m20221213232036246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232036246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232036246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232036246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232036246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232036246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232036258 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232036267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232036267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232036267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:39.640303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12342): Terminating (SIGTERM) 23:20:39.682797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12345): Terminating (SIGTERM) 23:20:39.726118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12349): Terminating (SIGTERM) 23:20:39.769174 --- ParallelTerminationStrategy: PID 12342 died... 23:20:39.789852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12342): Terminated: ok {rc=0} 23:20:39.837195 --- ParallelTerminationStrategy: PID 12345 died... 23:20:39.857400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12345): Terminated: ok {rc=0} 23:20:39.904597 --- ParallelTerminationStrategy: PID 12349 died... 23:20:39.924836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12349): Terminated: ok {rc=0} 23:20:40.015096 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:20:41.311617 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:20:41.318161 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:20:41.339342 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:20:41.378761 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:20:41.464794 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:20:41.486479 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:20:41.526913 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:20:42.119342 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:20:42.170097 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:42.181199 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:20:42.236930 tst cs_paging_gprs_active.py: using LAC 36926 23:20:42.357882 tst cs_paging_gprs_active.py: using RAC 206 23:20:42.478586 tst cs_paging_gprs_active.py: using CellId 36926 23:20:42.599013 tst cs_paging_gprs_active.py: using BVCI 36927 23:20:42.713815 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:42.724710 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:42.735434 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:42.746132 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:42.756843 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:42.767849 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:42.778865 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:42.789742 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:42.800708 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:20:42.918028 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:20:43.039995 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:20:43.266446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:43.603823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12355): Launched 23:20:43.895187 run iperf3-srv_10.42.42.10(pid=12356): Launched 23:20:44.019572 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:20:44.244395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:44.580417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12357): Launched 23:20:44.870997 run iperf3-srv_10.42.42.10(pid=12358): Launched 23:20:44.997787 tst cs_paging_gprs_active.py:38: start network... 23:20:45.223099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:45.741111 run create_hlr_db(pid=12359): Launched 23:20:45.880734 bus /gobi_6: Setting Powered False 23:20:46.959829 run create_hlr_db(pid=12359): Terminated: ok {rc=0} 23:20:47.461770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12361): Launched 23:20:47.797544 run osmo-hlr_10.42.42.2(pid=12362): Launched 23:20:47.924084 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:48.496698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12364): Launched 23:20:48.830852 run osmo-stp_10.42.42.5(pid=12365): Launched 23:20:48.957022 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:49.534291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12367): Launched 23:20:49.662218 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:49.944773 run patchelf(pid=12368): Launched 23:20:50.129336 run osmo-stp_10.42.42.5(pid=12365): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12365)] 23:20:50.269854 run osmo-stp_10.42.42.5(pid=12365): stdout: | (launched: 2022-12-13_23:20:48.768317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:50.412162 run osmo-stp_10.42.42.5(pid=12365): stderr: | [0;m[38;5;43m20221213232048962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232048962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232048963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232048963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232048965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232048966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232048966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:50.554371 run osmo-stp_10.42.42.5(pid=12365): stdout: | (launched: 2022-12-13_23:20:48.768317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:50.690399 run osmo-stp_10.42.42.5(pid=12365): stderr: | [0;m[38;5;43m20221213232048962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232048962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232048963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232048963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232048965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232048966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232048966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:50.851790 run patchelf(pid=12368): Terminating (SIGINT) 23:20:51.038438 run patchelf(pid=12368): Terminated: ok {rc=0} 23:20:51.172880 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12365): Process ended prematurely: osmo-stp_10.42.42.5(pid=12365) [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12365)] [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:20:51.183210 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 23:20:51.211888 run osmo-hlr_10.42.42.2(pid=12362): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12362)] 23:20:51.263359 run osmo-hlr_10.42.42.2(pid=12362): stdout: | (launched: 2022-12-13_23:20:47.734927) 23:20:51.316023 run osmo-hlr_10.42.42.2(pid=12362): stderr: | [0;m[1;31m20221213232047936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232047936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232047936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232047936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232047936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232047936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232047948 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232047957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232047957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232047957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:51.369559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12355): Terminating (SIGTERM) 23:20:51.411769 run iperf3-srv_10.42.42.10(pid=12356): Terminating (SIGTERM) 23:20:51.454640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12357): Terminating (SIGTERM) 23:20:51.497154 run iperf3-srv_10.42.42.10(pid=12358): Terminating (SIGTERM) 23:20:51.539742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12361): Terminating (SIGTERM) 23:20:51.582498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12364): Terminating (SIGTERM) 23:20:51.625032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12367): Terminating (SIGTERM) 23:20:51.667595 --- ParallelTerminationStrategy: PID 12355 died... 23:20:51.688166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12355): Terminated: ok {rc=0} 23:20:51.735540 --- ParallelTerminationStrategy: PID 12356 died... 23:20:51.755564 run iperf3-srv_10.42.42.10(pid=12356): Terminated {rc=256} 23:20:51.802155 --- ParallelTerminationStrategy: PID 12357 died... 23:20:51.822125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12357): Terminated: ok {rc=0} 23:20:51.868709 --- ParallelTerminationStrategy: PID 12358 died... 23:20:51.888726 run iperf3-srv_10.42.42.10(pid=12358): Terminated {rc=256} 23:20:51.935908 --- ParallelTerminationStrategy: PID 12361 died... 23:20:51.956083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12361): Terminated: ok {rc=0} 23:20:52.003053 --- ParallelTerminationStrategy: PID 12364 died... 23:20:52.023078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12364): Terminated: ok {rc=0} 23:20:52.069794 --- ParallelTerminationStrategy: PID 12367 died... 23:20:52.089770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12367): Terminated: ok {rc=0} 23:20:52.178102 bus /gobi_0: Setting Powered False 23:20:53.278058 bus /gobi_0: Setting Powered False 23:20:54.394967 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:20:55.546870 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:55.559040 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:20:55.621436 tst iperf3.py: using LAC 36927 23:20:55.753046 tst iperf3.py: using RAC 207 23:20:55.882427 tst iperf3.py: using CellId 36927 23:20:56.014528 tst iperf3.py: using BVCI 36928 23:20:56.136466 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:56.148058 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:56.159253 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:56.170552 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:56.182101 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:56.193646 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:56.205282 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:56.216621 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:56.228363 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:20:56.346235 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:20:56.556171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:56.871009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12372): Launched 23:20:57.144411 run iperf3-srv_10.42.42.10(pid=12373): Launched 23:20:57.260823 tst iperf3.py:8: start network... 23:20:57.469370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:57.951084 run create_hlr_db(pid=12374): Launched 23:20:58.078248 bus /gobi_6: Setting Powered False 23:20:59.144010 run create_hlr_db(pid=12374): Terminated: ok {rc=0} 23:20:59.589490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12376): Launched 23:20:59.901182 run osmo-hlr_10.42.42.2(pid=12377): Launched 23:21:00.019241 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:00.555854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12379): Launched 23:21:00.882644 run osmo-stp_10.42.42.5(pid=12380): Launched 23:21:01.055751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:01.861899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12382): Launched 23:21:01.992720 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:02.266948 run patchelf(pid=12383): Launched 23:21:02.450644 run osmo-stp_10.42.42.5(pid=12380): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12380)] 23:21:02.581428 run osmo-stp_10.42.42.5(pid=12380): stdout: | (launched: 2022-12-13_23:21:00.807972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:02.714541 run osmo-stp_10.42.42.5(pid=12380): stderr: | [0;m[38;5;43m20221213232101120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232101120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232101120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232101121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232101121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232101121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232101121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:02.847885 run osmo-stp_10.42.42.5(pid=12380): stdout: | (launched: 2022-12-13_23:21:00.807972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:02.975185 run osmo-stp_10.42.42.5(pid=12380): stderr: | [0;m[38;5;43m20221213232101120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232101120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232101120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232101121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232101121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232101121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232101121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:03.126669 run patchelf(pid=12383): Terminating (SIGINT) 23:21:03.300901 run patchelf(pid=12383): Terminated: ok {rc=0} 23:21:03.426494 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12380): Process ended prematurely: osmo-stp_10.42.42.5(pid=12380) [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12380)] [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 23:21:03.436096 tst iperf3.py:8: Test FAILED (7.9 sec) 23:21:03.463392 run osmo-hlr_10.42.42.2(pid=12377): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12377)] 23:21:03.512013 run osmo-hlr_10.42.42.2(pid=12377): stdout: | (launched: 2022-12-13_23:20:59.841974) 23:21:03.562204 run osmo-hlr_10.42.42.2(pid=12377): stderr: | [0;m[1;31m20221213232100022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232100022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232100022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232100023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232100023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232100023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232100035 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232100044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232100044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232100044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:03.612606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12372): Terminating (SIGTERM) 23:21:03.653137 run iperf3-srv_10.42.42.10(pid=12373): Terminating (SIGTERM) 23:21:03.693585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12376): Terminating (SIGTERM) 23:21:03.733751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12379): Terminating (SIGTERM) 23:21:03.773877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12382): Terminating (SIGTERM) 23:21:03.814368 --- ParallelTerminationStrategy: PID 12372 died... 23:21:03.833562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12372): Terminated: ok {rc=0} 23:21:03.877889 --- ParallelTerminationStrategy: PID 12373 died... 23:21:03.896500 run iperf3-srv_10.42.42.10(pid=12373): Terminated {rc=256} 23:21:03.940855 --- ParallelTerminationStrategy: PID 12376 died... 23:21:03.960140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12376): Terminated: ok {rc=0} 23:21:04.004700 --- ParallelTerminationStrategy: PID 12379 died... 23:21:04.023677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12379): Terminated: ok {rc=0} 23:21:04.068080 --- ParallelTerminationStrategy: PID 12382 died... 23:21:04.087067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12382): Terminated: ok {rc=0} 23:21:04.173404 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:21:05.323109 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.334743 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:21:05.392559 tst iperf3m4.py: using LAC 36928 23:21:05.514935 tst iperf3m4.py: using RAC 208 23:21:05.637238 tst iperf3m4.py: using CellId 36928 23:21:05.760044 tst iperf3m4.py: using BVCI 36929 23:21:05.874119 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.885112 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.895773 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.906534 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.917278 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.928374 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.939308 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.949986 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.960750 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:06.083735 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:06.204462 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:06.326459 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:06.444773 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:21:06.655304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:21:06.968386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12384): Launched 23:21:07.240845 run iperf3-srv_10.42.42.10(pid=12385): Launched 23:21:07.356832 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:21:07.565037 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:21:07.878112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12386): Launched 23:21:08.149318 run iperf3-srv_10.42.42.10(pid=12387): Launched 23:21:08.265087 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:21:08.471873 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:21:08.784227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12388): Launched 23:21:09.055597 run iperf3-srv_10.42.42.10(pid=12389): Launched 23:21:09.172530 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:21:09.379865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:21:09.693100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12390): Launched 23:21:09.964209 run iperf3-srv_10.42.42.10(pid=12391): Launched 23:21:10.079835 tst iperf3m4.py:8: start network... 23:21:10.287501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:10.768625 run create_hlr_db(pid=12392): Launched 23:21:10.894107 bus /gobi_6: Setting Powered False 23:21:11.955909 run create_hlr_db(pid=12392): Terminated: ok {rc=0} 23:21:12.389263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12394): Launched 23:21:12.702323 run osmo-hlr_10.42.42.2(pid=12395): Launched 23:21:12.820155 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:13.365532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12397): Launched 23:21:13.676212 run osmo-stp_10.42.42.5(pid=12398): Launched 23:21:13.795298 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:14.332804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12400): Launched 23:21:14.450900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:14.715289 run patchelf(pid=12401): Launched 23:21:14.888116 run osmo-stp_10.42.42.5(pid=12398): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12398)] 23:21:15.018984 run osmo-stp_10.42.42.5(pid=12398): stdout: | (launched: 2022-12-13_23:21:13.617415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:15.151723 run osmo-stp_10.42.42.5(pid=12398): stderr: | [0;m[38;5;43m20221213232113789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232113789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232113790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232113790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232113792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232113792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232113792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:15.285683 run osmo-stp_10.42.42.5(pid=12398): stdout: | (launched: 2022-12-13_23:21:13.617415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:15.412153 run osmo-stp_10.42.42.5(pid=12398): stderr: | [0;m[38;5;43m20221213232113789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232113789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232113790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232113790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232113792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232113792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232113792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:15.562989 run patchelf(pid=12401): Terminating (SIGINT) 23:21:15.736767 run patchelf(pid=12401): Terminated: ok {rc=0} 23:21:15.871448 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12398): Process ended prematurely: osmo-stp_10.42.42.5(pid=12398) [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12398)] [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:21:15.881549 tst iperf3m4.py:8: Test FAILED (10.6 sec) 23:21:15.909698 run osmo-hlr_10.42.42.2(pid=12395): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12395)] 23:21:15.960176 run osmo-hlr_10.42.42.2(pid=12395): stdout: | (launched: 2022-12-13_23:21:12.642536) 23:21:16.010657 run osmo-hlr_10.42.42.2(pid=12395): stderr: | [0;m[1;31m20221213232112826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232112826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232112826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232112826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232112826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232112826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232112838 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232112847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232112847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232112848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:16.061616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12384): Terminating (SIGTERM) 23:21:16.102552 run iperf3-srv_10.42.42.10(pid=12385): Terminating (SIGTERM) 23:21:16.144823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12386): Terminating (SIGTERM) 23:21:16.186643 run iperf3-srv_10.42.42.10(pid=12387): Terminating (SIGTERM) 23:21:16.230439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12388): Terminating (SIGTERM) 23:21:16.272211 run iperf3-srv_10.42.42.10(pid=12389): Terminating (SIGTERM) 23:21:16.314746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12390): Terminating (SIGTERM) 23:21:16.355601 run iperf3-srv_10.42.42.10(pid=12391): Terminating (SIGTERM) 23:21:16.396234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12394): Terminating (SIGTERM) 23:21:16.437814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12397): Terminating (SIGTERM) 23:21:16.481188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12400): Terminating (SIGTERM) 23:21:16.524367 --- ParallelTerminationStrategy: PID 12384 died... 23:21:16.544142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12384): Terminated: ok {rc=0} 23:21:16.589252 --- ParallelTerminationStrategy: PID 12385 died... 23:21:16.608197 run iperf3-srv_10.42.42.10(pid=12385): Terminated {rc=256} 23:21:16.652902 --- ParallelTerminationStrategy: PID 12386 died... 23:21:16.672405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12386): Terminated: ok {rc=0} 23:21:16.717256 --- ParallelTerminationStrategy: PID 12387 died... 23:21:16.736316 run iperf3-srv_10.42.42.10(pid=12387): Terminated {rc=256} 23:21:16.781390 --- ParallelTerminationStrategy: PID 12388 died... 23:21:16.800493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12388): Terminated: ok {rc=0} 23:21:16.845532 --- ParallelTerminationStrategy: PID 12389 died... 23:21:16.864803 run iperf3-srv_10.42.42.10(pid=12389): Terminated {rc=256} 23:21:16.909766 --- ParallelTerminationStrategy: PID 12390 died... 23:21:16.928939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12390): Terminated: ok {rc=0} 23:21:16.974091 --- ParallelTerminationStrategy: PID 12391 died... 23:21:16.993413 run iperf3-srv_10.42.42.10(pid=12391): Terminated {rc=256} 23:21:17.038407 --- ParallelTerminationStrategy: PID 12394 died... 23:21:17.057986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12394): Terminated: ok {rc=0} 23:21:17.103128 --- ParallelTerminationStrategy: PID 12397 died... 23:21:17.122526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12397): Terminated: ok {rc=0} 23:21:17.167404 --- ParallelTerminationStrategy: PID 12400 died... 23:21:17.186818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12400): Terminated: ok {rc=0} 23:21:17.273300 bus /gobi_4: Setting Powered False 23:21:18.371464 bus /gobi_4: Setting Powered False 23:21:19.487597 bus /gobi_1: Setting Powered False 23:21:20.586908 bus /gobi_1: Setting Powered False 23:21:21.705870 bus /gobi_0: Setting Powered False 23:21:22.805307 bus /gobi_0: Setting Powered False 23:21:23.921605 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:21:25.025833 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:25.037709 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:21:25.094577 tst ping.py: using LAC 36929 23:21:25.212905 tst ping.py: using RAC 209 23:21:25.332374 tst ping.py: using CellId 36929 23:21:25.462038 tst ping.py: using BVCI 36930 23:21:25.583791 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:25.595557 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:25.607040 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:25.618517 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:25.630209 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:25.641767 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:25.653603 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:25.665175 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:25.782807 tst ping.py:19: start network... 23:21:25.986843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:26.460672 run create_hlr_db(pid=12402): Launched 23:21:26.585773 bus /gobi_6: Setting Powered False 23:21:27.647386 run create_hlr_db(pid=12402): Terminated: ok {rc=0} 23:21:28.095513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12404): Launched 23:21:28.424263 run osmo-hlr_10.42.42.2(pid=12405): Launched 23:21:28.549374 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:29.121612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12407): Launched 23:21:29.450452 run osmo-stp_10.42.42.5(pid=12408): Launched 23:21:29.575052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:30.142627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12410): Launched 23:21:30.267354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:30.546214 run patchelf(pid=12411): Launched 23:21:30.728258 run osmo-stp_10.42.42.5(pid=12408): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12408)] 23:21:30.881623 run osmo-stp_10.42.42.5(pid=12408): stdout: | (launched: 2022-12-13_23:21:29.388848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:31.015678 run osmo-stp_10.42.42.5(pid=12408): stderr: | [0;m[38;5;43m20221213232129586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232129587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232129587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232129587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232129588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232129588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232129588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:31.151480 run osmo-stp_10.42.42.5(pid=12408): stdout: | (launched: 2022-12-13_23:21:29.388848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:31.280531 run osmo-stp_10.42.42.5(pid=12408): stderr: | [0;m[38;5;43m20221213232129586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232129587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232129587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232129587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232129588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232129588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232129588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:31.433559 run patchelf(pid=12411): Terminating (SIGINT) 23:21:31.609878 run patchelf(pid=12411): Terminated: ok {rc=0} 23:21:31.738577 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12408): Process ended prematurely: osmo-stp_10.42.42.5(pid=12408) [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12408)] [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 23:21:31.748002 tst ping.py:22: Test FAILED (6.7 sec) 23:21:31.775673 run osmo-hlr_10.42.42.2(pid=12405): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12405)] 23:21:31.825503 run osmo-hlr_10.42.42.2(pid=12405): stdout: | (launched: 2022-12-13_23:21:28.362668) 23:21:31.877808 run osmo-hlr_10.42.42.2(pid=12405): stderr: | [0;m[1;31m20221213232128562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232128562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232128562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232128562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232128562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232128562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232128575 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232128583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232128583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232128583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:31.929970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12404): Terminating (SIGTERM) 23:21:31.971792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12407): Terminating (SIGTERM) 23:21:32.015731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12410): Terminating (SIGTERM) 23:21:32.060091 --- ParallelTerminationStrategy: PID 12404 died... 23:21:32.081102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12404): Terminated: ok {rc=0} 23:21:32.128598 --- ParallelTerminationStrategy: PID 12407 died... 23:21:32.148903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12407): Terminated: ok {rc=0} 23:21:32.195514 --- ParallelTerminationStrategy: PID 12410 died... 23:21:32.215755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12410): Terminated: ok {rc=0} 23:21:32.302424 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:21:33.390760 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:33.402507 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:21:33.464175 tst ping_idle_ping.py: using LAC 36930 23:21:33.583605 tst ping_idle_ping.py: using RAC 210 23:21:33.701741 tst ping_idle_ping.py: using CellId 36930 23:21:33.829162 tst ping_idle_ping.py: using BVCI 36931 23:21:33.948561 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:33.960394 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:33.971727 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:33.983195 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:33.994828 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:34.006397 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:34.018286 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:34.029909 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:34.148659 tst ping_idle_ping.py:24: start network... 23:21:34.356426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:34.836404 run create_hlr_db(pid=12412): Launched 23:21:34.962387 bus /gobi_6: Setting Powered False 23:21:36.023412 run create_hlr_db(pid=12412): Terminated: ok {rc=0} 23:21:36.474576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12414): Launched 23:21:36.805975 run osmo-hlr_10.42.42.2(pid=12415): Launched 23:21:36.931587 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:37.498890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12417): Launched 23:21:37.829145 run osmo-stp_10.42.42.5(pid=12418): Launched 23:21:37.954317 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:38.524335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12420): Launched 23:21:38.651885 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:38.932004 run patchelf(pid=12421): Launched 23:21:39.114874 run osmo-stp_10.42.42.5(pid=12418): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12418)] 23:21:39.253931 run osmo-stp_10.42.42.5(pid=12418): stdout: | (launched: 2022-12-13_23:21:37.767132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:39.394988 run osmo-stp_10.42.42.5(pid=12418): stderr: | [0;m[38;5;43m20221213232137961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232137961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232137961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232137962 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232137964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232137964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232137964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:39.536123 run osmo-stp_10.42.42.5(pid=12418): stdout: | (launched: 2022-12-13_23:21:37.767132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:39.670716 run osmo-stp_10.42.42.5(pid=12418): stderr: | [0;m[38;5;43m20221213232137961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232137961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232137961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232137962 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232137964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232137964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232137964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:39.830453 run patchelf(pid=12421): Terminating (SIGINT) 23:21:40.014495 run patchelf(pid=12421): Terminated: ok {rc=0} 23:21:40.146910 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12418): Process ended prematurely: osmo-stp_10.42.42.5(pid=12418) [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12418)] [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:21:40.156554 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 23:21:40.185116 run osmo-hlr_10.42.42.2(pid=12415): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12415)] 23:21:40.236571 run osmo-hlr_10.42.42.2(pid=12415): stdout: | (launched: 2022-12-13_23:21:36.744065) 23:21:40.289871 run osmo-hlr_10.42.42.2(pid=12415): stderr: | [0;m[1;31m20221213232136947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232136947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232136947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232136947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232136947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232136947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232136978 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232136989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232136989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232136989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:40.343310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12414): Terminating (SIGTERM) 23:21:40.385420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12417): Terminating (SIGTERM) 23:21:40.428482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12420): Terminating (SIGTERM) 23:21:40.471576 --- ParallelTerminationStrategy: PID 12414 died... 23:21:40.492409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12414): Terminated: ok {rc=0} 23:21:40.539712 --- ParallelTerminationStrategy: PID 12417 died... 23:21:40.560019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12417): Terminated: ok {rc=0} 23:21:40.606970 --- ParallelTerminationStrategy: PID 12420 died... 23:21:40.627028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12420): Terminated: ok {rc=0} 23:21:40.716446 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:21:42.011664 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:21:42.018872 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:21:42.040117 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:21:42.077147 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:21:42.131931 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:21:42.153451 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:21:42.189172 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:21:42.751055 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:21:42.756638 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:42.768388 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:21:42.829045 tst switch_tch_pdch.py: using LAC 36931 23:21:42.956481 tst switch_tch_pdch.py: using RAC 211 23:21:43.083128 tst switch_tch_pdch.py: using CellId 36931 23:21:43.209645 tst switch_tch_pdch.py: using BVCI 36932 23:21:43.330595 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:43.342535 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:43.354446 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:43.366254 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:43.378077 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:43.390155 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:43.402427 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:43.414492 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:21:43.532672 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:21:43.649813 tst switch_tch_pdch.py:51: start network... 23:21:43.854059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:44.329043 run create_hlr_db(pid=12426): Launched 23:21:44.454584 bus /gobi_6: Setting Powered False 23:21:45.516219 run create_hlr_db(pid=12426): Terminated: ok {rc=0} 23:21:45.992898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12428): Launched 23:21:46.334426 run osmo-hlr_10.42.42.2(pid=12429): Launched 23:21:46.545171 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:47.232074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12431): Launched 23:21:47.560106 run osmo-stp_10.42.42.5(pid=12432): Launched 23:21:47.685211 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:48.250525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12434): Launched 23:21:48.374911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:48.652260 run patchelf(pid=12435): Launched 23:21:48.833118 run osmo-stp_10.42.42.5(pid=12432): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12432)] 23:21:48.970823 run osmo-stp_10.42.42.5(pid=12432): stdout: | (launched: 2022-12-13_23:21:47.498139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:49.110360 run osmo-stp_10.42.42.5(pid=12432): stderr: | [0;m[38;5;43m20221213232147696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232147696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232147696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232147696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232147697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232147697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232147697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:49.249614 run osmo-stp_10.42.42.5(pid=12432): stdout: | (launched: 2022-12-13_23:21:47.498139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:49.383597 run osmo-stp_10.42.42.5(pid=12432): stderr: | [0;m[38;5;43m20221213232147696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232147696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232147696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232147696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232147697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232147697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232147697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:49.542895 run patchelf(pid=12435): Terminating (SIGINT) 23:21:49.726109 run patchelf(pid=12435): Terminated: ok {rc=0} 23:21:49.857778 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12432): Process ended prematurely: osmo-stp_10.42.42.5(pid=12432) [trial-2396↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12432)] [trial-2396↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:21:49.867272 tst switch_tch_pdch.py:54: Test FAILED (7.1 sec) 23:21:49.895412 run osmo-hlr_10.42.42.2(pid=12429): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12429)] 23:21:49.946524 run osmo-hlr_10.42.42.2(pid=12429): stdout: | (launched: 2022-12-13_23:21:46.268606) 23:21:49.999412 run osmo-hlr_10.42.42.2(pid=12429): stderr: | [0;m[1;31m20221213232146612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232146612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232146612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232146612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232146612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232146612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232146627 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232146644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232146644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232146644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:50.052304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12428): Terminating (SIGTERM) 23:21:50.094904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12431): Terminating (SIGTERM) 23:21:50.137474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12434): Terminating (SIGTERM) 23:21:50.180587 --- ParallelTerminationStrategy: PID 12428 died... 23:21:50.201221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12428): Terminated: ok {rc=0} 23:21:50.248180 --- ParallelTerminationStrategy: PID 12431 died... 23:21:50.268361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12431): Terminated: ok {rc=0} 23:21:50.315043 --- ParallelTerminationStrategy: PID 12434 died... 23:21:50.335015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12434): Terminated: ok {rc=0} 23:21:50.423572 bus /gobi_0: Setting Powered False 23:21:51.522621 bus /gobi_0: Setting Powered False 23:21:52.641279 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:21:53.876527 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:21:53.882300 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:21:53.902937 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:21:53.937306 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:21:53.990303 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:21:54.011435 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:21:54.045610 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:21:54.603397 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:21:54.609047 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:54.620624 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:21:54.678914 tst switch_tch_pdch.py: using LAC 36932 23:21:54.809053 tst switch_tch_pdch.py: using RAC 212 23:21:54.930224 tst switch_tch_pdch.py: using CellId 36932 23:21:55.051411 tst switch_tch_pdch.py: using BVCI 36933 23:21:55.161817 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:55.172864 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:55.183860 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:55.194606 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:55.205326 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:55.216223 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:55.227133 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:55.238558 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:21:55.356072 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:21:55.476863 tst switch_tch_pdch.py:51: start network... 23:21:55.698599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:56.178501 run create_hlr_db(pid=12439): Launched 23:21:56.303877 bus /gobi_6: Setting Powered False 23:21:57.369476 run create_hlr_db(pid=12439): Terminated: ok {rc=0} 23:21:57.783854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12441): Launched 23:21:58.092485 run osmo-hlr_10.42.42.2(pid=12442): Launched 23:21:58.207750 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:58.705216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12444): Launched 23:21:59.009109 run osmo-stp_10.42.42.5(pid=12445): Launched 23:21:59.124408 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:59.623951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12447): Launched 23:21:59.739940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:59.998082 run patchelf(pid=12448): Launched 23:22:00.166061 run osmo-stp_10.42.42.5(pid=12445): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12445)] 23:22:00.294132 run osmo-stp_10.42.42.5(pid=12445): stdout: | (launched: 2022-12-13_23:21:58.951596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:00.423621 run osmo-stp_10.42.42.5(pid=12445): stderr: | [0;m[38;5;43m20221213232159125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232159125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232159125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232159126 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232159126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232159126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232159126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:00.553377 run osmo-stp_10.42.42.5(pid=12445): stdout: | (launched: 2022-12-13_23:21:58.951596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:00.677449 run osmo-stp_10.42.42.5(pid=12445): stderr: | [0;m[38;5;43m20221213232159125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232159125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232159125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232159126 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232159126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232159126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232159126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:00.824430 run patchelf(pid=12448): Terminating (SIGINT) 23:22:01.014546 run patchelf(pid=12448): Terminated: ok {rc=0} 23:22:01.150159 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12445): Process ended prematurely: osmo-stp_10.42.42.5(pid=12445) [trial-2396↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12445)] [trial-2396↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:22:01.160813 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 23:22:01.191051 run osmo-hlr_10.42.42.2(pid=12442): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12442)] 23:22:01.247236 run osmo-hlr_10.42.42.2(pid=12442): stdout: | (launched: 2022-12-13_23:21:58.035124) 23:22:01.303826 run osmo-hlr_10.42.42.2(pid=12442): stderr: | [0;m[1;31m20221213232158212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232158212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232158212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232158212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232158212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232158212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232158225 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232158235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232158235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232158235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:01.360435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12441): Terminating (SIGTERM) 23:22:01.405114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12444): Terminating (SIGTERM) 23:22:01.451842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12447): Terminating (SIGTERM) 23:22:01.500379 --- ParallelTerminationStrategy: PID 12441 died... 23:22:01.523009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12441): Terminated: ok {rc=0} 23:22:01.573038 --- ParallelTerminationStrategy: PID 12444 died... 23:22:01.595502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12444): Terminated: ok {rc=0} 23:22:01.647299 --- ParallelTerminationStrategy: PID 12447 died... 23:22:01.668740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12447): Terminated: ok {rc=0} 23:22:01.775242 bus /gobi_0: Setting Powered False 23:22:02.883231 bus /gobi_0: Setting Powered False 23:22:03.999130 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_sms:oc2g --------------------------------------------------------------------- 23:22:05.242302 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:05.246865 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 23:22:05.267633 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 23:22:05.274431 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 23:22:05.327866 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 23:22:05.350129 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 23:22:05.357130 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 23:22:05.893864 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 23:22:05.898662 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 23:22:05.909471 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 23:22:05.943166 tst mo_mt_sms.py: using LAC 36933 23:22:06.075620 tst mo_mt_sms.py: using RAC 213 23:22:06.195408 tst mo_mt_sms.py: using CellId 36933 23:22:06.312462 tst mo_mt_sms.py: using BVCI 36934 23:22:06.422465 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 23:22:06.542138 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 23:22:06.657560 tst mo_mt_sms.py:9: start nitb and bts... 23:22:06.860691 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:22:07.480319 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12452): Launched 23:22:07.787594 run osmo-nitb_10.42.42.2(pid=12453): Launched 23:22:07.954968 run osmo-nitb_10.42.42.2(pid=12453): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12453)] 23:22:08.094135 run osmo-nitb_10.42.42.2(pid=12453): stdout: | (launched: 2022-12-13_23:22:07.730345) 23:22:08.229278 run osmo-nitb_10.42.42.2(pid=12453): stderr: | (launched: 2022-12-13_23:22:07.775329) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:22:08.364410 run osmo-nitb_10.42.42.2(pid=12453): stdout: | (launched: 2022-12-13_23:22:07.730345) 23:22:08.494187 run osmo-nitb_10.42.42.2(pid=12453): stderr: | (launched: 2022-12-13_23:22:07.775329) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12453): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12453) [trial-2396↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12453)] 23:22:08.901523 tst osmo-nitb_10.42.42.2(pid=12453): stdout: | (launched: 2022-12-13_23:22:07.730345) 23:22:09.021537 tst osmo-nitb_10.42.42.2(pid=12453): stderr: | (launched: 2022-12-13_23:22:07.775329) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:22:09.162914 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12453): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12453) [trial-2396↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12453)] [trial-2396↪nitb_sms:oc2g↪mo_mt_sms.py:11] 23:22:09.171030 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 23:22:09.177490 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12452): Terminating (SIGTERM) 23:22:09.386039 --- ParallelTerminationStrategy: PID 12452 died... 23:22:09.407078 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12452): Terminated: ok {rc=0} 23:22:09.492409 bus /sierra_3: Setting Powered False 23:22:10.592366 bus /sierra_3: Setting Powered False 23:22:11.708676 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 sms:oc2g --------------------------------------------------------------------- 23:22:12.889541 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:12.893452 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 23:22:12.913593 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 23:22:12.940129 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 23:22:12.990948 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 23:22:13.011942 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 23:22:13.038263 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 23:22:13.583044 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 sms:oc2g mo_mt_sms.py ---------------------------------------------- 23:22:13.588112 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:22:13.598726 tst sms:oc2g: Using 1 x bts (candidates: 1) 23:22:13.650151 tst mo_mt_sms.py: using LAC 36934 23:22:13.772471 tst mo_mt_sms.py: using RAC 214 23:22:13.890380 tst mo_mt_sms.py: using CellId 36934 23:22:14.005487 tst mo_mt_sms.py: using BVCI 36935 23:22:14.115491 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:22:14.126079 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:22:14.136259 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:22:14.146557 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:22:14.156716 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:22:14.166921 tst sms:oc2g: Using 1 x modem (candidates: 2) 23:22:14.281155 tst sms:oc2g: Using 1 x modem (candidates: 2) 23:22:14.399077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:14.897742 run create_hlr_db(pid=12457): Launched 23:22:15.019178 bus /sierra_2: Setting Powered False 23:22:16.079527 run create_hlr_db(pid=12457): Terminated: ok {rc=0} 23:22:16.521374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12459): Launched 23:22:16.855453 run osmo-hlr_10.42.42.2(pid=12460): Launched 23:22:17.093363 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:17.683063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12462): Launched 23:22:18.006838 run osmo-stp_10.42.42.5(pid=12463): Launched 23:22:18.129158 run osmo-msc_10.42.42.6: Starting osmo-msc 23:22:18.710583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12465): Launched 23:22:19.032872 run osmo-msc_10.42.42.6(pid=12466): Launched 23:22:19.211434 run osmo-stp_10.42.42.5(pid=12463): ERR: Terminated: ERROR {rc=1} [trial-2396↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12463)] 23:22:19.347339 run osmo-stp_10.42.42.5(pid=12463): stdout: | (launched: 2022-12-13_23:22:17.946291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:19.483594 run osmo-stp_10.42.42.5(pid=12463): stderr: | [0;m[38;5;43m20221213232218139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232218139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232218140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232218140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232218141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232218141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232218141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:19.619519 run osmo-stp_10.42.42.5(pid=12463): stdout: | (launched: 2022-12-13_23:22:17.946291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:19.747361 run osmo-stp_10.42.42.5(pid=12463): stderr: | [0;m[38;5;43m20221213232218139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232218139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232218140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232218140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232218141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232218141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232218141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:19.900005 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12463): Process ended prematurely: osmo-stp_10.42.42.5(pid=12463) [trial-2396↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12463)] [trial-2396↪sms:oc2g↪mo_mt_sms.py:16] 23:22:19.908909 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 23:22:19.936120 run osmo-hlr_10.42.42.2(pid=12460): ERR: Terminated: ERROR {rc=237} [trial-2396↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12460)] 23:22:19.986715 run osmo-hlr_10.42.42.2(pid=12460): stdout: | (launched: 2022-12-13_23:22:16.785500) 23:22:20.038710 run osmo-hlr_10.42.42.2(pid=12460): stderr: | [0;m[1;31m20221213232217123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232217123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232217123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232217123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232217123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232217123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232217144 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232217152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232217152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232217152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:20.111697 run osmo-msc_10.42.42.6(pid=12466): ERR: Terminated: ERROR {rc=2} [trial-2396↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12466)] 23:22:20.161954 run osmo-msc_10.42.42.6(pid=12466): stdout: | (launched: 2022-12-13_23:22:18.972586) 23:22:20.213965 run osmo-msc_10.42.42.6(pid=12466): stderr: | [0;m[38;5;43m20221213232219297 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232219297 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff00e10bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232219297 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232219297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232219297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232219297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232219299 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232219299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232219300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232219300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:22:20.266434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12459): Terminating (SIGTERM) 23:22:20.308485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12462): Terminating (SIGTERM) 23:22:20.350539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12465): Terminating (SIGTERM) 23:22:20.393781 --- ParallelTerminationStrategy: PID 12459 died... 23:22:20.414204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12459): Terminated: ok {rc=0} 23:22:20.460760 --- ParallelTerminationStrategy: PID 12462 died... 23:22:20.480838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12462): Terminated: ok {rc=0} 23:22:20.527525 --- ParallelTerminationStrategy: PID 12465 died... 23:22:20.547689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12465): Terminated: ok {rc=0} 23:22:20.637377 bus /sierra_3: Setting Powered False 23:22:21.736704 bus /sierra_3: Setting Powered False 23:22:22.856397 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_ussd:oc2g --------------------------------------------------------------------- 23:22:24.070329 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:24.074274 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 23:22:24.095990 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 23:22:24.102892 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 23:22:24.139525 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 23:22:24.160870 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 23:22:24.167926 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 23:22:24.688726 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2396 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 23:22:24.694253 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 23:22:24.705516 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 23:22:24.739982 tst assert_extension.py: using LAC 36935 23:22:24.865585 tst assert_extension.py: using RAC 215 23:22:24.983369 tst assert_extension.py: using CellId 36935 23:22:25.102245 tst assert_extension.py: using BVCI 36936 23:22:25.214180 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 23:22:25.332433 tst assert_extension.py:10: start nitb and bts... 23:22:25.533028 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:22:26.143458 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12471): Launched 23:22:26.443395 run osmo-nitb_10.42.42.2(pid=12472): Launched 23:22:26.609262 run osmo-nitb_10.42.42.2(pid=12472): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12472)] 23:22:26.743043 run osmo-nitb_10.42.42.2(pid=12472): stdout: | (launched: 2022-12-13_23:22:26.386668) 23:22:26.878168 run osmo-nitb_10.42.42.2(pid=12472): stderr: | (launched: 2022-12-13_23:22:26.430942) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:22:27.013151 run osmo-nitb_10.42.42.2(pid=12472): stdout: | (launched: 2022-12-13_23:22:26.386668) 23:22:27.142764 run osmo-nitb_10.42.42.2(pid=12472): stderr: | (launched: 2022-12-13_23:22:26.430942) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12472) [trial-2396↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12472)] 23:22:27.556371 tst osmo-nitb_10.42.42.2(pid=12472): stdout: | (launched: 2022-12-13_23:22:26.386668) 23:22:27.676646 tst osmo-nitb_10.42.42.2(pid=12472): stderr: | (launched: 2022-12-13_23:22:26.430942) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:22:27.818733 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12472) [trial-2396↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12472)] [trial-2396↪nitb_ussd:oc2g↪assert_extension.py:12] 23:22:27.826860 tst assert_extension.py:12: Test FAILED (3.1 sec) 23:22:27.833438 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12471): Terminating (SIGTERM) 23:22:28.042137 --- ParallelTerminationStrategy: PID 12471 died... 23:22:28.063210 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12471): Terminated: ok {rc=0} 23:22:28.150524 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 ussd:oc2g --------------------------------------------------------------------- 23:22:29.312638 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:29.318057 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 23:22:29.339625 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 23:22:29.368330 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 23:22:29.408248 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 23:22:29.429727 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 23:22:29.457225 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 23:22:29.981472 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2396 ussd:oc2g assert_extension.py ---------------------------------------------- 23:22:29.986643 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:29.997663 tst ussd:oc2g: Using 1 x bts (candidates: 1) 23:22:30.032041 tst assert_extension.py: using LAC 36936 23:22:30.154954 tst assert_extension.py: using RAC 216 23:22:30.271489 tst assert_extension.py: using CellId 36936 23:22:30.387494 tst assert_extension.py: using BVCI 36937 23:22:30.494851 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:30.505525 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:30.515987 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:30.526261 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:30.536675 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:30.547533 tst ussd:oc2g: Using 1 x modem (candidates: 1) 23:22:30.668030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:31.214440 run create_hlr_db(pid=12476): Launched 23:22:31.374515 bus /sierra_2: Setting Powered False 23:22:32.434964 run create_hlr_db(pid=12476): Terminated: ok {rc=0} 23:22:32.874169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12478): Launched 23:22:33.195182 run osmo-hlr_10.42.42.2(pid=12479): Launched 23:22:33.317902 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:33.879483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12481): Launched 23:22:34.201215 run osmo-stp_10.42.42.5(pid=12482): Launched 23:22:34.323655 run osmo-msc_10.42.42.6: Starting osmo-msc 23:22:34.903239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12484): Launched 23:22:35.224250 run osmo-msc_10.42.42.6(pid=12485): Launched 23:22:35.403759 run osmo-stp_10.42.42.5(pid=12482): ERR: Terminated: ERROR {rc=1} [trial-2396↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12482)] 23:22:35.539339 run osmo-stp_10.42.42.5(pid=12482): stdout: | (launched: 2022-12-13_23:22:34.141174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:35.676047 run osmo-stp_10.42.42.5(pid=12482): stderr: | [0;m[38;5;43m20221213232234336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232234336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232234336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232234336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232234337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232234337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232234337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:35.811782 run osmo-stp_10.42.42.5(pid=12482): stdout: | (launched: 2022-12-13_23:22:34.141174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:35.939943 run osmo-stp_10.42.42.5(pid=12482): stderr: | [0;m[38;5;43m20221213232234336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232234336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232234336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232234336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232234337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232234337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232234337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:36.092504 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12482): Process ended prematurely: osmo-stp_10.42.42.5(pid=12482) [trial-2396↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12482)] [trial-2396↪ussd:oc2g↪assert_extension.py:17] 23:22:36.101507 tst assert_extension.py:17: Test FAILED (6.1 sec) 23:22:36.128783 run osmo-hlr_10.42.42.2(pid=12479): ERR: Terminated: ERROR {rc=237} [trial-2396↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12479)] 23:22:36.179082 run osmo-hlr_10.42.42.2(pid=12479): stdout: | (launched: 2022-12-13_23:22:33.135071) 23:22:36.230650 run osmo-hlr_10.42.42.2(pid=12479): stderr: | [0;m[1;31m20221213232233334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232233334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232233334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232233334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232233334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232233334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232233347 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232233355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232233355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232233356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:36.303076 run osmo-msc_10.42.42.6(pid=12485): ERR: Terminated: ERROR {rc=2} [trial-2396↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12485)] 23:22:36.352875 run osmo-msc_10.42.42.6(pid=12485): stdout: | (launched: 2022-12-13_23:22:35.164204) 23:22:36.404398 run osmo-msc_10.42.42.6(pid=12485): stderr: | [0;m[38;5;43m20221213232235486 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232235486 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2d10e86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232235486 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232235486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232235486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232235487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232235490 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232235490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232235491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232235491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:22:36.456365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12478): Terminating (SIGTERM) 23:22:36.498057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12481): Terminating (SIGTERM) 23:22:36.539624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12484): Terminating (SIGTERM) 23:22:36.582003 --- ParallelTerminationStrategy: PID 12478 died... 23:22:36.602286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12478): Terminated: ok {rc=0} 23:22:36.648289 --- ParallelTerminationStrategy: PID 12481 died... 23:22:36.668078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12481): Terminated: ok {rc=0} 23:22:36.714356 --- ParallelTerminationStrategy: PID 12484 died... 23:22:36.734049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12484): Terminated: ok {rc=0} 23:22:36.821867 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:22:38.011202 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:38.017389 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:22:38.037690 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:22:38.064119 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:22:38.115449 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:22:38.136211 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:22:38.162482 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:22:38.712128 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:22:38.765495 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:38.786991 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:22:38.842261 tst mo_mt_call.py: using LAC 36937 23:22:38.961376 tst mo_mt_call.py: using RAC 217 23:22:39.078700 tst mo_mt_call.py: using CellId 36937 23:22:39.198438 tst mo_mt_call.py: using BVCI 36938 23:22:39.308217 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:39.319192 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:39.329951 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:39.340680 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:39.351743 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:39.362533 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:22:39.483841 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:22:39.600689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:40.067777 run create_hlr_db(pid=12490): Launched 23:22:40.191216 bus /sierra_2: Setting Powered False 23:22:41.251478 run create_hlr_db(pid=12490): Terminated: ok {rc=0} 23:22:41.671134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12492): Launched 23:22:41.972891 run osmo-hlr_10.42.42.2(pid=12493): Launched 23:22:42.086454 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:42.600717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12495): Launched 23:22:42.900380 run osmo-stp_10.42.42.5(pid=12496): Launched 23:22:43.014825 run osmo-msc_10.42.42.6: Starting osmo-msc 23:22:43.556267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12498): Launched 23:22:43.856007 run osmo-msc_10.42.42.6(pid=12499): Launched 23:22:44.025504 run osmo-stp_10.42.42.5(pid=12496): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12496)] 23:22:44.152658 run osmo-stp_10.42.42.5(pid=12496): stdout: | (launched: 2022-12-13_23:22:42.845541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:44.279789 run osmo-stp_10.42.42.5(pid=12496): stderr: | [0;m[38;5;43m20221213232243015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232243015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232243015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232243016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232243016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232243016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232243016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:44.404670 run osmo-stp_10.42.42.5(pid=12496): stdout: | (launched: 2022-12-13_23:22:42.845541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:44.524306 run osmo-stp_10.42.42.5(pid=12496): stderr: | [0;m[38;5;43m20221213232243015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232243015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232243015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232243016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232243016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232243016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232243016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:44.667438 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12496): Process ended prematurely: osmo-stp_10.42.42.5(pid=12496) [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12496)] [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:22:44.676332 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:22:44.702761 run osmo-hlr_10.42.42.2(pid=12493): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12493)] 23:22:44.750580 run osmo-hlr_10.42.42.2(pid=12493): stdout: | (launched: 2022-12-13_23:22:41.918201) 23:22:44.799824 run osmo-hlr_10.42.42.2(pid=12493): stderr: | [0;m[1;31m20221213232242095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232242095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232242095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232242095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232242095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232242095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232242108 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232242117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232242117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232242117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:44.868656 run osmo-msc_10.42.42.6(pid=12499): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12499)] 23:22:44.916292 run osmo-msc_10.42.42.6(pid=12499): stdout: | (launched: 2022-12-13_23:22:43.801067) 23:22:44.965666 run osmo-msc_10.42.42.6(pid=12499): stderr: | [0;m[38;5;43m20221213232244072 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232244072 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd461612c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232244073 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232244073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232244073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232244073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232244075 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232244075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232244075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232244075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:22:45.015522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12492): Terminating (SIGTERM) 23:22:45.055092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12495): Terminating (SIGTERM) 23:22:45.094632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12498): Terminating (SIGTERM) 23:22:45.134571 --- ParallelTerminationStrategy: PID 12492 died... 23:22:45.153980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12492): Terminated: ok {rc=0} 23:22:45.198067 --- ParallelTerminationStrategy: PID 12495 died... 23:22:45.216724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12495): Terminated: ok {rc=0} 23:22:45.260573 --- ParallelTerminationStrategy: PID 12498 died... 23:22:45.279477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12498): Terminated: ok {rc=0} 23:22:45.364832 bus /sierra_3: Setting Powered False 23:22:46.471695 bus /sierra_3: Setting Powered False 23:22:47.597362 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:22:48.745971 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:48.758075 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:22:48.816889 tst mo_mt_call_osmux.py: using LAC 36938 23:22:48.945517 tst mo_mt_call_osmux.py: using RAC 218 23:22:49.067839 tst mo_mt_call_osmux.py: using CellId 36938 23:22:49.185199 tst mo_mt_call_osmux.py: using BVCI 36939 23:22:49.293251 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:49.304285 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:49.315278 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:49.326211 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:49.336885 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:49.347752 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:22:49.466527 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:22:49.582891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:50.043218 run create_hlr_db(pid=12501): Launched 23:22:50.164365 bus /sierra_2: Setting Powered False 23:22:51.224842 run create_hlr_db(pid=12501): Terminated: ok {rc=0} 23:22:51.659613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12503): Launched 23:22:51.958552 run osmo-hlr_10.42.42.2(pid=12504): Launched 23:22:52.071990 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:52.583831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12506): Launched 23:22:52.880626 run osmo-stp_10.42.42.5(pid=12507): Launched 23:22:53.004307 run osmo-msc_10.42.42.6: Starting osmo-msc 23:22:53.582251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12509): Launched 23:22:53.899660 run osmo-msc_10.42.42.6(pid=12510): Launched 23:22:54.076930 run osmo-stp_10.42.42.5(pid=12507): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12507)] 23:22:54.211318 run osmo-stp_10.42.42.5(pid=12507): stdout: | (launched: 2022-12-13_23:22:52.826176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:54.346610 run osmo-stp_10.42.42.5(pid=12507): stderr: | [0;m[38;5;43m20221213232253010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232253010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232253010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232253011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232253011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232253011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232253011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:54.480872 run osmo-stp_10.42.42.5(pid=12507): stdout: | (launched: 2022-12-13_23:22:52.826176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:54.607875 run osmo-stp_10.42.42.5(pid=12507): stderr: | [0;m[38;5;43m20221213232253010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232253010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232253010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232253011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232253011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232253011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232253011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:54.759694 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12507): Process ended prematurely: osmo-stp_10.42.42.5(pid=12507) [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12507)] [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:22:54.769083 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:22:54.796507 run osmo-hlr_10.42.42.2(pid=12504): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12504)] 23:22:54.847070 run osmo-hlr_10.42.42.2(pid=12504): stdout: | (launched: 2022-12-13_23:22:51.904684) 23:22:54.898802 run osmo-hlr_10.42.42.2(pid=12504): stderr: | [0;m[1;31m20221213232252078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232252078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232252079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232252079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232252079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232252079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232252090 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232252099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232252099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232252099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:54.970802 run osmo-msc_10.42.42.6(pid=12510): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12510)] 23:22:55.020428 run osmo-msc_10.42.42.6(pid=12510): stdout: | (launched: 2022-12-13_23:22:53.842406) 23:22:55.071902 run osmo-msc_10.42.42.6(pid=12510): stderr: | [0;m[38;5;43m20221213232254161 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232254161 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f68ec0d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232254161 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232254162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232254162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232254162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232254164 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232254164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232254164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232254164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:22:55.124131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12503): Terminating (SIGTERM) 23:22:55.165777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12506): Terminating (SIGTERM) 23:22:55.207311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12509): Terminating (SIGTERM) 23:22:55.249290 --- ParallelTerminationStrategy: PID 12503 died... 23:22:55.269554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12503): Terminated: ok {rc=0} 23:22:55.316005 --- ParallelTerminationStrategy: PID 12506 died... 23:22:55.335745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12506): Terminated: ok {rc=0} 23:22:55.381746 --- ParallelTerminationStrategy: PID 12509 died... 23:22:55.401460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12509): Terminated: ok {rc=0} 23:22:55.489074 bus /sierra_3: Setting Powered False 23:22:56.587253 bus /sierra_3: Setting Powered False 23:22:57.705981 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:22:58.937472 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:58.943694 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:22:58.963911 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:22:58.990491 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:22:59.040721 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:22:59.061006 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:22:59.087186 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:22:59.638934 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:22:59.687458 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:59.698711 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:22:59.753752 tst mo_mt_call.py: using LAC 36939 23:22:59.871782 tst mo_mt_call.py: using RAC 219 23:22:59.997845 tst mo_mt_call.py: using CellId 36939 23:23:00.116556 tst mo_mt_call.py: using BVCI 36940 23:23:00.226195 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:00.237254 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:00.248019 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:00.258771 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:00.269542 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:00.280284 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:23:00.395245 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:23:00.513350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:01.036755 run create_hlr_db(pid=12515): Launched 23:23:01.192485 bus /sierra_2: Setting Powered False 23:23:02.255266 run create_hlr_db(pid=12515): Terminated: ok {rc=0} 23:23:02.683808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12517): Launched 23:23:02.981260 run osmo-hlr_10.42.42.2(pid=12518): Launched 23:23:03.094259 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:03.619881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12520): Launched 23:23:03.916228 run osmo-stp_10.42.42.5(pid=12521): Launched 23:23:04.029241 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:04.578001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12523): Launched 23:23:04.874789 run osmo-msc_10.42.42.6(pid=12524): Launched 23:23:05.041242 run osmo-stp_10.42.42.5(pid=12521): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12521)] 23:23:05.167256 run osmo-stp_10.42.42.5(pid=12521): stdout: | (launched: 2022-12-13_23:23:03.862048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:05.293169 run osmo-stp_10.42.42.5(pid=12521): stderr: | [0;m[38;5;43m20221213232304031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232304031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232304031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232304031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232304032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232304032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232304032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:05.416587 run osmo-stp_10.42.42.5(pid=12521): stdout: | (launched: 2022-12-13_23:23:03.862048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:05.534783 run osmo-stp_10.42.42.5(pid=12521): stderr: | [0;m[38;5;43m20221213232304031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232304031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232304031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232304031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232304032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232304032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232304032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:05.676755 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12521): Process ended prematurely: osmo-stp_10.42.42.5(pid=12521) [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12521)] [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:23:05.685580 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:23:05.711821 run osmo-hlr_10.42.42.2(pid=12518): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12518)] 23:23:05.760185 run osmo-hlr_10.42.42.2(pid=12518): stdout: | (launched: 2022-12-13_23:23:02.927144) 23:23:05.809488 run osmo-hlr_10.42.42.2(pid=12518): stderr: | [0;m[1;31m20221213232303102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232303102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232303102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232303102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232303102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232303102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232303114 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232303125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232303125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232303125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:05.878484 run osmo-msc_10.42.42.6(pid=12524): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12524)] 23:23:05.926159 run osmo-msc_10.42.42.6(pid=12524): stdout: | (launched: 2022-12-13_23:23:04.820312) 23:23:05.975173 run osmo-msc_10.42.42.6(pid=12524): stderr: | [0;m[38;5;43m20221213232305093 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232305093 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbc641b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232305093 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232305093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232305094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232305094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232305095 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232305096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232305096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232305096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:06.025241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12517): Terminating (SIGTERM) 23:23:06.064875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12520): Terminating (SIGTERM) 23:23:06.104754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12523): Terminating (SIGTERM) 23:23:06.144507 --- ParallelTerminationStrategy: PID 12517 died... 23:23:06.163503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12517): Terminated: ok {rc=0} 23:23:06.207708 --- ParallelTerminationStrategy: PID 12520 died... 23:23:06.226343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12520): Terminated: ok {rc=0} 23:23:06.270164 --- ParallelTerminationStrategy: PID 12523 died... 23:23:06.288820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12523): Terminated: ok {rc=0} 23:23:06.372211 bus /sierra_3: Setting Powered False 23:23:07.470298 bus /sierra_3: Setting Powered False 23:23:08.589639 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:23:09.734886 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:09.746364 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:23:09.801389 tst mo_mt_call_osmux.py: using LAC 36940 23:23:09.918480 tst mo_mt_call_osmux.py: using RAC 220 23:23:10.038300 tst mo_mt_call_osmux.py: using CellId 36940 23:23:10.157378 tst mo_mt_call_osmux.py: using BVCI 36941 23:23:10.264869 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:10.275851 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:10.286595 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:10.297392 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:10.308182 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:10.318928 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:23:10.438668 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:23:10.558120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:11.017660 run create_hlr_db(pid=12526): Launched 23:23:11.138778 bus /sierra_2: Setting Powered False 23:23:12.198572 run create_hlr_db(pid=12526): Terminated: ok {rc=0} 23:23:12.614195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12528): Launched 23:23:12.909806 run osmo-hlr_10.42.42.2(pid=12529): Launched 23:23:13.023793 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:13.531509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12531): Launched 23:23:13.826591 run osmo-stp_10.42.42.5(pid=12532): Launched 23:23:13.939468 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:14.475040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12534): Launched 23:23:14.770666 run osmo-msc_10.42.42.6(pid=12535): Launched 23:23:14.935884 run osmo-stp_10.42.42.5(pid=12532): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12532)] 23:23:15.061187 run osmo-stp_10.42.42.5(pid=12532): stdout: | (launched: 2022-12-13_23:23:13.773049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:15.186883 run osmo-stp_10.42.42.5(pid=12532): stderr: | [0;m[38;5;43m20221213232313941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232313941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232313942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232313942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232313942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232313942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232313943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:15.310195 run osmo-stp_10.42.42.5(pid=12532): stdout: | (launched: 2022-12-13_23:23:13.773049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:15.427844 run osmo-stp_10.42.42.5(pid=12532): stderr: | [0;m[38;5;43m20221213232313941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232313941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232313942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232313942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232313942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232313942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232313943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:15.568640 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12532): Process ended prematurely: osmo-stp_10.42.42.5(pid=12532) [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12532)] [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:23:15.577373 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 23:23:15.603320 run osmo-hlr_10.42.42.2(pid=12529): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12529)] 23:23:15.650525 run osmo-hlr_10.42.42.2(pid=12529): stdout: | (launched: 2022-12-13_23:23:12.855942) 23:23:15.699291 run osmo-hlr_10.42.42.2(pid=12529): stderr: | [0;m[1;31m20221213232313029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232313029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232313029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232313029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232313029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232313029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232313044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232313054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232313055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232313055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:15.767539 run osmo-msc_10.42.42.6(pid=12535): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12535)] 23:23:15.814437 run osmo-msc_10.42.42.6(pid=12535): stdout: | (launched: 2022-12-13_23:23:14.716693) 23:23:15.873445 run osmo-msc_10.42.42.6(pid=12535): stderr: | [0;m[38;5;43m20221213232314988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232314988 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f75a4c8dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232314988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232314988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232314988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232314989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232314990 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232314991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232314991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232314991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:15.923779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12528): Terminating (SIGTERM) 23:23:15.963640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12531): Terminating (SIGTERM) 23:23:16.006591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12534): Terminating (SIGTERM) 23:23:16.046736 --- ParallelTerminationStrategy: PID 12528 died... 23:23:16.065857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12528): Terminated: ok {rc=0} 23:23:16.110493 --- ParallelTerminationStrategy: PID 12531 died... 23:23:16.129700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12531): Terminated: ok {rc=0} 23:23:16.174898 --- ParallelTerminationStrategy: PID 12534 died... 23:23:16.193926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12534): Terminated: ok {rc=0} 23:23:16.277325 bus /sierra_3: Setting Powered False 23:23:17.371909 bus /sierra_3: Setting Powered False 23:23:18.488301 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:23:19.724231 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:23:19.731133 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:23:19.752052 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:23:19.780024 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:23:19.833834 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:23:19.854149 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:23:19.880441 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:23:20.431037 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:23:20.483450 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:20.494950 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:23:20.551629 tst mo_mt_call.py: using LAC 36941 23:23:20.681827 tst mo_mt_call.py: using RAC 221 23:23:20.804903 tst mo_mt_call.py: using CellId 36941 23:23:20.927687 tst mo_mt_call.py: using BVCI 36942 23:23:21.043666 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:21.055190 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:21.066413 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:21.077660 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:21.089160 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:21.100598 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:23:21.220031 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:23:21.336430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:21.796516 run create_hlr_db(pid=12540): Launched 23:23:21.919019 bus /sierra_2: Setting Powered False 23:23:22.978967 run create_hlr_db(pid=12540): Terminated: ok {rc=0} 23:23:23.414037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12542): Launched 23:23:23.732444 run osmo-hlr_10.42.42.2(pid=12543): Launched 23:23:23.854039 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:24.402976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12545): Launched 23:23:24.722447 run osmo-stp_10.42.42.5(pid=12546): Launched 23:23:24.844252 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:25.421075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12548): Launched 23:23:25.740510 run osmo-msc_10.42.42.6(pid=12549): Launched 23:23:25.918802 run osmo-stp_10.42.42.5(pid=12546): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12546)] 23:23:26.054551 run osmo-stp_10.42.42.5(pid=12546): stdout: | (launched: 2022-12-13_23:23:24.664752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:26.190314 run osmo-stp_10.42.42.5(pid=12546): stderr: | [0;m[38;5;43m20221213232324856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232324856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232324856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232324857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232324857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232324857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232324857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:26.325477 run osmo-stp_10.42.42.5(pid=12546): stdout: | (launched: 2022-12-13_23:23:24.664752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:26.453233 run osmo-stp_10.42.42.5(pid=12546): stderr: | [0;m[38;5;43m20221213232324856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232324856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232324856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232324857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232324857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232324857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232324857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:26.606275 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12546): Process ended prematurely: osmo-stp_10.42.42.5(pid=12546) [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12546)] [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:23:26.615826 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:23:26.643552 run osmo-hlr_10.42.42.2(pid=12543): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12543)] 23:23:26.694484 run osmo-hlr_10.42.42.2(pid=12543): stdout: | (launched: 2022-12-13_23:23:23.675101) 23:23:26.746281 run osmo-hlr_10.42.42.2(pid=12543): stderr: | [0;m[1;31m20221213232323870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232323870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232323870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232323870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232323870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232323870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232323882 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232323890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232323890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232323891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:26.818547 run osmo-msc_10.42.42.6(pid=12549): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12549)] 23:23:26.867679 run osmo-msc_10.42.42.6(pid=12549): stdout: | (launched: 2022-12-13_23:23:25.682359) 23:23:26.918846 run osmo-msc_10.42.42.6(pid=12549): stderr: | [0;m[38;5;43m20221213232326001 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232326001 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff8baa21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232326001 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232326001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232326002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232326002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232326003 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232326004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232326004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232326004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:26.970630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12542): Terminating (SIGTERM) 23:23:27.011789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12545): Terminating (SIGTERM) 23:23:27.053022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12548): Terminating (SIGTERM) 23:23:27.094713 --- ParallelTerminationStrategy: PID 12542 died... 23:23:27.114822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12542): Terminated: ok {rc=0} 23:23:27.160738 --- ParallelTerminationStrategy: PID 12545 died... 23:23:27.180623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12545): Terminated: ok {rc=0} 23:23:27.226558 --- ParallelTerminationStrategy: PID 12548 died... 23:23:27.246250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12548): Terminated: ok {rc=0} 23:23:27.332782 bus /sierra_3: Setting Powered False 23:23:28.431158 bus /sierra_3: Setting Powered False 23:23:29.546410 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:23:30.695855 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:30.707923 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:23:30.766440 tst mo_mt_call_osmux.py: using LAC 36942 23:23:30.921225 tst mo_mt_call_osmux.py: using RAC 222 23:23:31.048454 tst mo_mt_call_osmux.py: using CellId 36942 23:23:31.185911 tst mo_mt_call_osmux.py: using BVCI 36943 23:23:31.298096 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:31.310081 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:31.321528 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:31.333243 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:31.345447 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:31.357679 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:23:31.476208 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:23:31.617946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:32.152635 run create_hlr_db(pid=12551): Launched 23:23:32.306909 bus /sierra_2: Setting Powered False 23:23:33.370085 run create_hlr_db(pid=12551): Terminated: ok {rc=0} 23:23:33.796368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12553): Launched 23:23:34.094510 run osmo-hlr_10.42.42.2(pid=12554): Launched 23:23:34.207396 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:34.735184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12556): Launched 23:23:35.031580 run osmo-stp_10.42.42.5(pid=12557): Launched 23:23:35.145093 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:35.683923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12559): Launched 23:23:35.980616 run osmo-msc_10.42.42.6(pid=12560): Launched 23:23:36.147962 run osmo-stp_10.42.42.5(pid=12557): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12557)] 23:23:36.274023 run osmo-stp_10.42.42.5(pid=12557): stdout: | (launched: 2022-12-13_23:23:34.977389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:36.400175 run osmo-stp_10.42.42.5(pid=12557): stderr: | [0;m[38;5;43m20221213232335148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232335149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232335149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232335149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232335150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232335150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232335150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:36.524591 run osmo-stp_10.42.42.5(pid=12557): stdout: | (launched: 2022-12-13_23:23:34.977389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:36.643571 run osmo-stp_10.42.42.5(pid=12557): stderr: | [0;m[38;5;43m20221213232335148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232335149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232335149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232335149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232335150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232335150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232335150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:36.786042 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12557): Process ended prematurely: osmo-stp_10.42.42.5(pid=12557) [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12557)] [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:23:36.794955 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:23:36.821453 run osmo-hlr_10.42.42.2(pid=12554): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12554)] 23:23:36.869389 run osmo-hlr_10.42.42.2(pid=12554): stdout: | (launched: 2022-12-13_23:23:34.039926) 23:23:36.918738 run osmo-hlr_10.42.42.2(pid=12554): stderr: | [0;m[1;31m20221213232334213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232334213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232334213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232334213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232334213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232334213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232334225 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232334234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232334234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232334234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:36.987505 run osmo-msc_10.42.42.6(pid=12560): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12560)] 23:23:37.034647 run osmo-msc_10.42.42.6(pid=12560): stdout: | (launched: 2022-12-13_23:23:35.926210) 23:23:37.083565 run osmo-msc_10.42.42.6(pid=12560): stderr: | [0;m[38;5;43m20221213232336198 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232336198 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f01d64c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232336199 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232336199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232336199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232336199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232336201 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232336201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232336201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232336201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:37.133127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12553): Terminating (SIGTERM) 23:23:37.172473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12556): Terminating (SIGTERM) 23:23:37.211736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12559): Terminating (SIGTERM) 23:23:37.251433 --- ParallelTerminationStrategy: PID 12553 died... 23:23:37.270636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12553): Terminated: ok {rc=0} 23:23:37.314507 --- ParallelTerminationStrategy: PID 12556 died... 23:23:37.333308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12556): Terminated: ok {rc=0} 23:23:37.377124 --- ParallelTerminationStrategy: PID 12559 died... 23:23:37.395881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12559): Terminated: ok {rc=0} 23:23:37.480464 bus /sierra_3: Setting Powered False 23:23:38.578610 bus /sierra_3: Setting Powered False 23:23:39.691941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:23:40.926387 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:23:40.934490 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:23:40.955357 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:23:40.983485 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:23:41.035465 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:23:41.056921 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:23:41.085168 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:23:41.632659 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:23:41.686489 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:41.698079 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:23:41.754060 tst mo_mt_call.py: using LAC 36943 23:23:41.879325 tst mo_mt_call.py: using RAC 223 23:23:42.003146 tst mo_mt_call.py: using CellId 36943 23:23:42.126896 tst mo_mt_call.py: using BVCI 36944 23:23:42.244234 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:42.255778 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:42.266984 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:42.278540 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:42.290211 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:42.301974 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:23:42.419343 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:23:42.536827 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:42.997523 run create_hlr_db(pid=12565): Launched 23:23:43.120151 bus /sierra_2: Setting Powered False 23:23:44.179275 run create_hlr_db(pid=12565): Terminated: ok {rc=0} 23:23:44.616733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12567): Launched 23:23:44.935842 run osmo-hlr_10.42.42.2(pid=12568): Launched 23:23:45.057921 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:45.607036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12570): Launched 23:23:45.966955 run osmo-stp_10.42.42.5(pid=12571): Launched 23:23:46.267095 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:46.861865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12573): Launched 23:23:47.192414 run osmo-msc_10.42.42.6(pid=12574): Launched 23:23:47.395805 run osmo-stp_10.42.42.5(pid=12571): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12571)] 23:23:47.528846 run osmo-stp_10.42.42.5(pid=12571): stdout: | (launched: 2022-12-13_23:23:45.879844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:47.665359 run osmo-stp_10.42.42.5(pid=12571): stderr: | [0;m[38;5;43m20221213232346229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232346229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232346230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232346230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232346230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232346231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232346231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:47.798757 run osmo-stp_10.42.42.5(pid=12571): stdout: | (launched: 2022-12-13_23:23:45.879844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:47.925923 run osmo-stp_10.42.42.5(pid=12571): stderr: | [0;m[38;5;43m20221213232346229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232346229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232346230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232346230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232346230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232346231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232346231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:48.078211 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12571): Process ended prematurely: osmo-stp_10.42.42.5(pid=12571) [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12571)] [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:23:48.087859 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:23:48.115543 run osmo-hlr_10.42.42.2(pid=12568): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12568)] 23:23:48.166482 run osmo-hlr_10.42.42.2(pid=12568): stdout: | (launched: 2022-12-13_23:23:44.878411) 23:23:48.218922 run osmo-hlr_10.42.42.2(pid=12568): stderr: | [0;m[1;31m20221213232345075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232345075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232345075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232345075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232345075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232345075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232345089 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232345097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232345097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232345097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:48.291307 run osmo-msc_10.42.42.6(pid=12574): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12574)] 23:23:48.341146 run osmo-msc_10.42.42.6(pid=12574): stdout: | (launched: 2022-12-13_23:23:47.122206) 23:23:48.393194 run osmo-msc_10.42.42.6(pid=12574): stderr: | [0;m[38;5;43m20221213232347461 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232347461 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4503aadc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232347461 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232347461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232347461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232347462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232347464 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232347465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232347465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232347465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:48.445979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12567): Terminating (SIGTERM) 23:23:48.487804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12570): Terminating (SIGTERM) 23:23:48.529664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12573): Terminating (SIGTERM) 23:23:48.572910 --- ParallelTerminationStrategy: PID 12567 died... 23:23:48.593193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12567): Terminated: ok {rc=0} 23:23:48.639613 --- ParallelTerminationStrategy: PID 12570 died... 23:23:48.659439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12570): Terminated: ok {rc=0} 23:23:48.705474 --- ParallelTerminationStrategy: PID 12573 died... 23:23:48.725197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12573): Terminated: ok {rc=0} 23:23:48.813483 bus /sierra_3: Setting Powered False 23:23:49.912570 bus /sierra_3: Setting Powered False 23:23:51.029898 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:23:52.174411 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:52.186025 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:23:52.242252 tst mo_mt_call_osmux.py: using LAC 36944 23:23:52.359127 tst mo_mt_call_osmux.py: using RAC 224 23:23:52.478446 tst mo_mt_call_osmux.py: using CellId 36944 23:23:52.595543 tst mo_mt_call_osmux.py: using BVCI 36945 23:23:52.704881 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:52.715863 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:52.726711 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:52.737513 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:52.748464 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:52.759527 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:23:52.879136 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:23:53.002309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:53.497418 run create_hlr_db(pid=12577): Launched 23:23:53.620638 bus /sierra_2: Setting Powered False 23:23:54.684124 run create_hlr_db(pid=12577): Terminated: ok {rc=0} 23:23:55.128232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12579): Launched 23:23:55.446027 run osmo-hlr_10.42.42.2(pid=12580): Launched 23:23:55.568176 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:56.119131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12582): Launched 23:23:56.435970 run osmo-stp_10.42.42.5(pid=12583): Launched 23:23:56.558128 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:57.133760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12585): Launched 23:23:57.452351 run osmo-msc_10.42.42.6(pid=12586): Launched 23:23:57.631344 run osmo-stp_10.42.42.5(pid=12583): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12583)] 23:23:57.768127 run osmo-stp_10.42.42.5(pid=12583): stdout: | (launched: 2022-12-13_23:23:56.378555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:57.903483 run osmo-stp_10.42.42.5(pid=12583): stderr: | [0;m[38;5;43m20221213232356571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232356572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232356572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232356572 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232356573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232356573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232356573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:58.038042 run osmo-stp_10.42.42.5(pid=12583): stdout: | (launched: 2022-12-13_23:23:56.378555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:58.165051 run osmo-stp_10.42.42.5(pid=12583): stderr: | [0;m[38;5;43m20221213232356571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232356572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232356572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232356572 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232356573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232356573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232356573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:58.316939 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12583): Process ended prematurely: osmo-stp_10.42.42.5(pid=12583) [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12583)] [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:23:58.326529 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:23:58.354047 run osmo-hlr_10.42.42.2(pid=12580): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12580)] 23:23:58.404152 run osmo-hlr_10.42.42.2(pid=12580): stdout: | (launched: 2022-12-13_23:23:55.388546) 23:23:58.455554 run osmo-hlr_10.42.42.2(pid=12580): stderr: | [0;m[1;31m20221213232355586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232355586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232355586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232355586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232355586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232355586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232355599 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232355607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232355607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232355607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:58.528119 run osmo-msc_10.42.42.6(pid=12586): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12586)] 23:23:58.577463 run osmo-msc_10.42.42.6(pid=12586): stdout: | (launched: 2022-12-13_23:23:57.394479) 23:23:58.629055 run osmo-msc_10.42.42.6(pid=12586): stderr: | [0;m[38;5;43m20221213232357714 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232357715 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff98cd07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232357715 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232357715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232357715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232357715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232357717 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232357717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232357717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232357717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:58.680726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12579): Terminating (SIGTERM) 23:23:58.721995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12582): Terminating (SIGTERM) 23:23:58.763235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12585): Terminating (SIGTERM) 23:23:58.804886 --- ParallelTerminationStrategy: PID 12579 died... 23:23:58.825034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12579): Terminated: ok {rc=0} 23:23:58.870811 --- ParallelTerminationStrategy: PID 12582 died... 23:23:58.890457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12582): Terminated: ok {rc=0} 23:23:58.936005 --- ParallelTerminationStrategy: PID 12585 died... 23:23:58.955637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12585): Terminated: ok {rc=0} 23:23:59.041886 bus /sierra_3: Setting Powered False 23:24:00.137698 bus /sierra_3: Setting Powered False 23:24:01.301380 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:24:02.627629 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:02.638139 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:24:02.663811 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:24:02.703670 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:24:02.767932 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:24:02.802920 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:24:02.845501 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:24:03.403010 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:24:03.463216 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:03.475660 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:24:03.544371 tst mo_mt_call.py: using LAC 36945 23:24:03.689911 tst mo_mt_call.py: using RAC 225 23:24:03.832124 tst mo_mt_call.py: using CellId 36945 23:24:03.962105 tst mo_mt_call.py: using BVCI 36946 23:24:04.105734 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:04.117506 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:04.128908 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:04.140780 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:04.152750 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:04.164901 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:24:04.283335 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:24:04.403904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:04.892899 run create_hlr_db(pid=12860): Launched 23:24:05.051453 bus /sierra_2: Setting Powered False 23:24:06.112076 run create_hlr_db(pid=12860): Terminated: ok {rc=0} 23:24:06.558140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12864): Launched 23:24:06.874680 run osmo-hlr_10.42.42.2(pid=12865): Launched 23:24:07.112467 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:07.841877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12867): Launched 23:24:08.181661 run osmo-stp_10.42.42.5(pid=12868): Launched 23:24:08.419937 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:09.105674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12870): Launched 23:24:09.444562 run osmo-msc_10.42.42.6(pid=12871): Launched 23:24:09.805309 run osmo-stp_10.42.42.5(pid=12868): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12868)] 23:24:10.086187 run osmo-stp_10.42.42.5(pid=12868): stdout: | (launched: 2022-12-13_23:24:08.110021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:10.268139 run osmo-stp_10.42.42.5(pid=12868): stderr: | [0;m[38;5;43m20221213232408407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232408407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232408408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232408408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232408410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232408410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232408410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:10.406217 run osmo-stp_10.42.42.5(pid=12868): stdout: | (launched: 2022-12-13_23:24:08.110021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:10.538190 run osmo-stp_10.42.42.5(pid=12868): stderr: | [0;m[38;5;43m20221213232408407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232408407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232408408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232408408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232408410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232408410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232408410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:10.697075 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12868): Process ended prematurely: osmo-stp_10.42.42.5(pid=12868) [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12868)] [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:24:10.708501 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 23:24:10.739838 run osmo-hlr_10.42.42.2(pid=12865): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12865)] 23:24:10.794241 run osmo-hlr_10.42.42.2(pid=12865): stdout: | (launched: 2022-12-13_23:24:06.813068) 23:24:10.848545 run osmo-hlr_10.42.42.2(pid=12865): stderr: | [0;m[1;31m20221213232407160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232407160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232407160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232407160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232407160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232407160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232407172 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232407188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232407188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232407188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:10.923854 run osmo-msc_10.42.42.6(pid=12871): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12871)] 23:24:10.976284 run osmo-msc_10.42.42.6(pid=12871): stdout: | (launched: 2022-12-13_23:24:09.379706) 23:24:11.030787 run osmo-msc_10.42.42.6(pid=12871): stderr: | [0;m[38;5;43m20221213232409893 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232409893 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f151c28cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232409893 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232409893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232409893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232409894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232409897 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232409898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232409898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232409898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:11.085385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12864): Terminating (SIGTERM) 23:24:11.129438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12867): Terminating (SIGTERM) 23:24:11.175800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12870): Terminating (SIGTERM) 23:24:11.222401 --- ParallelTerminationStrategy: PID 12864 died... 23:24:11.244324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12864): Terminated: ok {rc=0} 23:24:11.294603 --- ParallelTerminationStrategy: PID 12867 died... 23:24:11.315935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12867): Terminated: ok {rc=0} 23:24:11.364714 --- ParallelTerminationStrategy: PID 12870 died... 23:24:11.386327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12870): Terminated: ok {rc=0} 23:24:11.479053 bus /sierra_3: Setting Powered False 23:24:12.582889 bus /sierra_3: Setting Powered False 23:24:13.706354 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:24:14.864858 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:14.877971 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:24:14.939746 tst mo_mt_call_osmux.py: using LAC 36946 23:24:15.068740 tst mo_mt_call_osmux.py: using RAC 226 23:24:15.198989 tst mo_mt_call_osmux.py: using CellId 36946 23:24:15.329383 tst mo_mt_call_osmux.py: using BVCI 36947 23:24:15.451254 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:15.463962 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:15.476171 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:15.488830 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:15.503297 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:15.516902 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:24:15.643038 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:24:15.773656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:16.342361 run create_hlr_db(pid=12873): Launched 23:24:16.529091 bus /sierra_2: Setting Powered False 23:24:17.605359 run create_hlr_db(pid=12873): Terminated: ok {rc=0} 23:24:18.084465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12875): Launched 23:24:18.409677 run osmo-hlr_10.42.42.2(pid=12876): Launched 23:24:18.646465 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:19.369733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12878): Launched 23:24:19.693709 run osmo-stp_10.42.42.5(pid=12879): Launched 23:24:19.930539 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:20.645699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12881): Launched 23:24:21.001715 run osmo-msc_10.42.42.6(pid=12882): Launched 23:24:21.368192 run osmo-stp_10.42.42.5(pid=12879): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12879)] 23:24:21.647702 run osmo-stp_10.42.42.5(pid=12879): stdout: | (launched: 2022-12-13_23:24:19.623268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:21.826344 run osmo-stp_10.42.42.5(pid=12879): stderr: | [0;m[38;5;43m20221213232419956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232419957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232419957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232419957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232419958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232419958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232419958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:21.968683 run osmo-stp_10.42.42.5(pid=12879): stdout: | (launched: 2022-12-13_23:24:19.623268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:22.100421 run osmo-stp_10.42.42.5(pid=12879): stderr: | [0;m[38;5;43m20221213232419956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232419957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232419957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232419957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232419958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232419958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232419958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:22.259942 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12879): Process ended prematurely: osmo-stp_10.42.42.5(pid=12879) [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12879)] [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:24:22.270360 tst mo_mt_call_osmux.py:8: Test FAILED (7.4 sec) 23:24:22.299955 run osmo-hlr_10.42.42.2(pid=12876): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12876)] 23:24:22.356408 run osmo-hlr_10.42.42.2(pid=12876): stdout: | (launched: 2022-12-13_23:24:18.339890) 23:24:22.412165 run osmo-hlr_10.42.42.2(pid=12876): stderr: | [0;m[1;31m20221213232418682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232418682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232418682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232418682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232418682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232418682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232418699 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232418711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232418712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232418712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:22.488771 run osmo-msc_10.42.42.6(pid=12882): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12882)] 23:24:22.543514 run osmo-msc_10.42.42.6(pid=12882): stdout: | (launched: 2022-12-13_23:24:20.927549) 23:24:22.599030 run osmo-msc_10.42.42.6(pid=12882): stderr: | [0;m[38;5;43m20221213232421436 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232421436 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd275958c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232421436 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232421436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232421437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232421437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232421438 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232421439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232421439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232421439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:22.655413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12875): Terminating (SIGTERM) 23:24:22.700176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12878): Terminating (SIGTERM) 23:24:22.749934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12881): Terminating (SIGTERM) 23:24:22.796789 --- ParallelTerminationStrategy: PID 12875 died... 23:24:22.819175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12875): Terminated: ok {rc=0} 23:24:22.869890 --- ParallelTerminationStrategy: PID 12878 died... 23:24:22.891519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12878): Terminated: ok {rc=0} 23:24:22.941583 --- ParallelTerminationStrategy: PID 12881 died... 23:24:22.963550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12881): Terminated: ok {rc=0} 23:24:23.056520 bus /sierra_3: Setting Powered False 23:24:24.162202 bus /sierra_3: Setting Powered False 23:24:25.279057 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:24:26.514695 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:26.520832 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:24:26.540788 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:24:26.567190 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:24:26.619092 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:24:26.640148 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:24:26.667857 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:24:27.218694 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:24:27.268878 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:27.279871 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:24:27.334649 tst mo_mt_call.py: using LAC 36947 23:24:27.452022 tst mo_mt_call.py: using RAC 227 23:24:27.567102 tst mo_mt_call.py: using CellId 36947 23:24:27.682393 tst mo_mt_call.py: using BVCI 36948 23:24:27.800752 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:27.812499 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:27.823941 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:27.835418 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:27.847200 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:27.859268 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:24:27.974685 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:24:28.093787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:28.588539 run create_hlr_db(pid=12887): Launched 23:24:28.711074 bus /sierra_2: Setting Powered False 23:24:29.775372 run create_hlr_db(pid=12887): Terminated: ok {rc=0} 23:24:30.202067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12889): Launched 23:24:30.499150 run osmo-hlr_10.42.42.2(pid=12890): Launched 23:24:30.613488 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:31.178974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12892): Launched 23:24:31.495587 run osmo-stp_10.42.42.5(pid=12893): Launched 23:24:31.775112 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:32.395605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12895): Launched 23:24:32.692663 run osmo-msc_10.42.42.6(pid=12896): Launched 23:24:32.860350 run osmo-stp_10.42.42.5(pid=12893): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12893)] 23:24:32.985940 run osmo-stp_10.42.42.5(pid=12893): stdout: | (launched: 2022-12-13_23:24:31.427127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:33.111942 run osmo-stp_10.42.42.5(pid=12893): stderr: | [0;m[38;5;43m20221213232431672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232431672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232431672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232431672 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232431673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232431673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232431673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:33.235699 run osmo-stp_10.42.42.5(pid=12893): stdout: | (launched: 2022-12-13_23:24:31.427127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:33.354381 run osmo-stp_10.42.42.5(pid=12893): stderr: | [0;m[38;5;43m20221213232431672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232431672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232431672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232431672 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232431673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232431673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232431673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:33.495733 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12893): Process ended prematurely: osmo-stp_10.42.42.5(pid=12893) [trial-2396↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12893)] [trial-2396↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:24:33.504480 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:24:33.530966 run osmo-hlr_10.42.42.2(pid=12890): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12890)] 23:24:33.578316 run osmo-hlr_10.42.42.2(pid=12890): stdout: | (launched: 2022-12-13_23:24:30.445495) 23:24:33.627472 run osmo-hlr_10.42.42.2(pid=12890): stderr: | [0;m[1;31m20221213232430621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232430621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232430621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232430621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232430621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232430621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232430633 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232430642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232430642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232430642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:33.696057 run osmo-msc_10.42.42.6(pid=12896): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12896)] 23:24:33.743955 run osmo-msc_10.42.42.6(pid=12896): stdout: | (launched: 2022-12-13_23:24:32.638447) 23:24:33.792832 run osmo-msc_10.42.42.6(pid=12896): stderr: | [0;m[38;5;43m20221213232432912 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232432912 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5685bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232432912 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232432912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232432912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232432913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232432914 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232432915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232432915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232432915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:33.842284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12889): Terminating (SIGTERM) 23:24:33.881478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12892): Terminating (SIGTERM) 23:24:33.920674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12895): Terminating (SIGTERM) 23:24:33.960223 --- ParallelTerminationStrategy: PID 12889 died... 23:24:33.979026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12889): Terminated: ok {rc=0} 23:24:34.022687 --- ParallelTerminationStrategy: PID 12892 died... 23:24:34.041202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12892): Terminated: ok {rc=0} 23:24:34.084870 --- ParallelTerminationStrategy: PID 12895 died... 23:24:34.103889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12895): Terminated: ok {rc=0} 23:24:34.188626 bus /sierra_3: Setting Powered False 23:24:35.286196 bus /sierra_3: Setting Powered False 23:24:36.400468 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:24:37.544397 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:37.556478 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:24:37.613311 tst mo_mt_call_osmux.py: using LAC 36948 23:24:37.732521 tst mo_mt_call_osmux.py: using RAC 228 23:24:37.860727 tst mo_mt_call_osmux.py: using CellId 36948 23:24:37.979304 tst mo_mt_call_osmux.py: using BVCI 36949 23:24:38.089146 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:38.100164 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:38.111026 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:38.121864 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:38.132519 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:38.143504 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:24:38.262564 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:24:38.381777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:38.880309 run create_hlr_db(pid=12898): Launched 23:24:39.002953 bus /sierra_2: Setting Powered False 23:24:40.066453 run create_hlr_db(pid=12898): Terminated: ok {rc=0} 23:24:40.494540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12900): Launched 23:24:40.791935 run osmo-hlr_10.42.42.2(pid=12901): Launched 23:24:40.907220 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:41.419454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12903): Launched 23:24:41.716441 run osmo-stp_10.42.42.5(pid=12904): Launched 23:24:41.830127 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:42.368291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12906): Launched 23:24:42.666325 run osmo-msc_10.42.42.6(pid=12907): Launched 23:24:42.833115 run osmo-stp_10.42.42.5(pid=12904): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12904)] 23:24:42.958883 run osmo-stp_10.42.42.5(pid=12904): stdout: | (launched: 2022-12-13_23:24:41.661984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:43.084666 run osmo-stp_10.42.42.5(pid=12904): stderr: | [0;m[38;5;43m20221213232441832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232441832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232441832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232441833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232441833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232441833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232441833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:43.208641 run osmo-stp_10.42.42.5(pid=12904): stdout: | (launched: 2022-12-13_23:24:41.661984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:43.326779 run osmo-stp_10.42.42.5(pid=12904): stderr: | [0;m[38;5;43m20221213232441832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232441832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232441832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232441833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232441833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232441833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232441833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:43.468005 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12904): Process ended prematurely: osmo-stp_10.42.42.5(pid=12904) [trial-2396↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12904)] [trial-2396↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:24:43.476707 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:24:43.502818 run osmo-hlr_10.42.42.2(pid=12901): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12901)] 23:24:43.549887 run osmo-hlr_10.42.42.2(pid=12901): stdout: | (launched: 2022-12-13_23:24:40.738023) 23:24:43.598598 run osmo-hlr_10.42.42.2(pid=12901): stderr: | [0;m[1;31m20221213232440912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232440912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232440912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232440912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232440912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232440912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232440924 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232440933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232440934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232440934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:43.666985 run osmo-msc_10.42.42.6(pid=12907): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12907)] 23:24:43.713940 run osmo-msc_10.42.42.6(pid=12907): stdout: | (launched: 2022-12-13_23:24:42.611692) 23:24:43.762614 run osmo-msc_10.42.42.6(pid=12907): stderr: | [0;m[38;5;43m20221213232442886 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232442886 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc5f30ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232442886 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232442886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232442886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232442886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232442888 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232442888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232442888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232442889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:43.811665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12900): Terminating (SIGTERM) 23:24:43.850603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12903): Terminating (SIGTERM) 23:24:43.889556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12906): Terminating (SIGTERM) 23:24:43.928759 --- ParallelTerminationStrategy: PID 12900 died... 23:24:43.947807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12900): Terminated: ok {rc=0} 23:24:43.991269 --- ParallelTerminationStrategy: PID 12903 died... 23:24:44.009835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12903): Terminated: ok {rc=0} 23:24:44.053111 --- ParallelTerminationStrategy: PID 12906 died... 23:24:44.071472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12906): Terminated: ok {rc=0} 23:24:44.155936 bus /sierra_3: Setting Powered False 23:24:45.254244 bus /sierra_3: Setting Powered False 23:24:46.375830 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:24:47.613956 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:47.620060 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:24:47.641348 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:24:47.670011 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:24:47.722810 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:24:47.743949 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:24:47.771720 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:24:48.320646 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:24:48.373169 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:48.384362 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:24:48.442319 tst mo_mt_call.py: using LAC 36949 23:24:48.571619 tst mo_mt_call.py: using RAC 229 23:24:48.698790 tst mo_mt_call.py: using CellId 36949 23:24:48.825370 tst mo_mt_call.py: using BVCI 36950 23:24:48.942964 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:48.954568 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:48.965809 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:48.976857 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:48.988404 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:48.999950 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:24:49.119189 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:24:49.238876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:49.733264 run create_hlr_db(pid=12912): Launched 23:24:49.855389 bus /sierra_2: Setting Powered False 23:24:50.918562 run create_hlr_db(pid=12912): Terminated: ok {rc=0} 23:24:51.344315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12914): Launched 23:24:51.641555 run osmo-hlr_10.42.42.2(pid=12915): Launched 23:24:51.757986 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:52.269406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12917): Launched 23:24:52.566938 run osmo-stp_10.42.42.5(pid=12918): Launched 23:24:52.681129 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:53.221257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12920): Launched 23:24:53.518671 run osmo-msc_10.42.42.6(pid=12921): Launched 23:24:53.685488 run osmo-stp_10.42.42.5(pid=12918): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12918)] 23:24:53.812610 run osmo-stp_10.42.42.5(pid=12918): stdout: | (launched: 2022-12-13_23:24:52.512538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:53.938904 run osmo-stp_10.42.42.5(pid=12918): stderr: | [0;m[38;5;43m20221213232452682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232452682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232452683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232452683 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232452683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232452683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232452684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:54.062799 run osmo-stp_10.42.42.5(pid=12918): stdout: | (launched: 2022-12-13_23:24:52.512538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:54.181312 run osmo-stp_10.42.42.5(pid=12918): stderr: | [0;m[38;5;43m20221213232452682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232452682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232452683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232452683 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232452683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232452683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232452684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:54.323041 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12918): Process ended prematurely: osmo-stp_10.42.42.5(pid=12918) [trial-2396↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12918)] [trial-2396↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:24:54.331835 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:24:54.358132 run osmo-hlr_10.42.42.2(pid=12915): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12915)] 23:24:54.405760 run osmo-hlr_10.42.42.2(pid=12915): stdout: | (launched: 2022-12-13_23:24:51.587376) 23:24:54.455087 run osmo-hlr_10.42.42.2(pid=12915): stderr: | [0;m[1;31m20221213232451762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232451763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232451763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232451763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232451763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232451763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232451776 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232451786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232451787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232451787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:54.523621 run osmo-msc_10.42.42.6(pid=12921): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12921)] 23:24:54.571074 run osmo-msc_10.42.42.6(pid=12921): stdout: | (launched: 2022-12-13_23:24:53.464444) 23:24:54.620076 run osmo-msc_10.42.42.6(pid=12921): stderr: | [0;m[38;5;43m20221213232453734 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232453734 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd742c87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232453734 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232453734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232453735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232453735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232453738 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232453739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232453739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232453739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:54.669433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12914): Terminating (SIGTERM) 23:24:54.708899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12917): Terminating (SIGTERM) 23:24:54.748248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12920): Terminating (SIGTERM) 23:24:54.788135 --- ParallelTerminationStrategy: PID 12914 died... 23:24:54.807575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12914): Terminated: ok {rc=0} 23:24:54.851682 --- ParallelTerminationStrategy: PID 12917 died... 23:24:54.870514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12917): Terminated: ok {rc=0} 23:24:54.914229 --- ParallelTerminationStrategy: PID 12920 died... 23:24:54.933387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12920): Terminated: ok {rc=0} 23:24:55.017326 bus /sierra_3: Setting Powered False 23:24:56.113644 bus /sierra_3: Setting Powered False 23:24:57.228279 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:24:58.377827 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:58.389809 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:24:58.447966 tst mo_mt_call_osmux.py: using LAC 36950 23:24:58.577440 tst mo_mt_call_osmux.py: using RAC 230 23:24:58.702629 tst mo_mt_call_osmux.py: using CellId 36950 23:24:58.831052 tst mo_mt_call_osmux.py: using BVCI 36951 23:24:58.947794 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:58.959228 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:58.970336 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:58.981423 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:58.992753 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:59.004250 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:24:59.122705 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:24:59.243711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:59.738642 run create_hlr_db(pid=12923): Launched 23:24:59.860116 bus /sierra_2: Setting Powered False 23:25:00.950157 run create_hlr_db(pid=12923): Terminated: ok {rc=0} 23:25:01.401789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12925): Launched 23:25:01.724883 run osmo-hlr_10.42.42.2(pid=12926): Launched 23:25:01.917629 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:02.563902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12931): Launched 23:25:02.860914 run osmo-stp_10.42.42.5(pid=12932): Launched 23:25:02.974493 run osmo-msc_10.42.42.6: Starting osmo-msc 23:25:03.519144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12934): Launched 23:25:03.816846 run osmo-msc_10.42.42.6(pid=12935): Launched 23:25:03.984054 run osmo-stp_10.42.42.5(pid=12932): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12932)] 23:25:04.110410 run osmo-stp_10.42.42.5(pid=12932): stdout: | (launched: 2022-12-13_23:25:02.806594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:04.237138 run osmo-stp_10.42.42.5(pid=12932): stderr: | [0;m[38;5;43m20221213232502977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232502977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232502977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232502978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232502978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232502978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232502978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:04.361528 run osmo-stp_10.42.42.5(pid=12932): stdout: | (launched: 2022-12-13_23:25:02.806594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:04.480557 run osmo-stp_10.42.42.5(pid=12932): stderr: | [0;m[38;5;43m20221213232502977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232502977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232502977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232502978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232502978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232502978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232502978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:04.622687 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12932): Process ended prematurely: osmo-stp_10.42.42.5(pid=12932) [trial-2396↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12932)] [trial-2396↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:25:04.631367 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:25:04.657602 run osmo-hlr_10.42.42.2(pid=12926): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12926)] 23:25:04.705335 run osmo-hlr_10.42.42.2(pid=12926): stdout: | (launched: 2022-12-13_23:25:01.660521) 23:25:04.754427 run osmo-hlr_10.42.42.2(pid=12926): stderr: | [0;m[1;31m20221213232502049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232502050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232502050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232502050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232502050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232502050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232502070 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232502090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232502090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232502090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:04.823027 run osmo-msc_10.42.42.6(pid=12935): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12935)] 23:25:04.870105 run osmo-msc_10.42.42.6(pid=12935): stdout: | (launched: 2022-12-13_23:25:03.762523) 23:25:04.918968 run osmo-msc_10.42.42.6(pid=12935): stderr: | [0;m[38;5;43m20221213232504033 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232504034 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9f31b62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232504034 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232504034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232504034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232504034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232504036 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232504036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232504036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232504036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:25:04.968243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12925): Terminating (SIGTERM) 23:25:05.007618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12931): Terminating (SIGTERM) 23:25:05.047119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12934): Terminating (SIGTERM) 23:25:05.086686 --- ParallelTerminationStrategy: PID 12925 died... 23:25:05.105646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12925): Terminated: ok {rc=0} 23:25:05.149385 --- ParallelTerminationStrategy: PID 12931 died... 23:25:05.167762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12931): Terminated: ok {rc=0} 23:25:05.212081 --- ParallelTerminationStrategy: PID 12934 died... 23:25:05.230982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12934): Terminated: ok {rc=0} 23:25:05.315726 bus /sierra_3: Setting Powered False 23:25:06.414960 bus /sierra_3: Setting Powered False 23:25:07.532662 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 emergency:oc2g --------------------------------------------------------------------- 23:25:08.763094 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:25:08.767587 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 23:25:08.787791 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 23:25:08.814523 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 23:25:08.897492 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 23:25:08.917737 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 23:25:08.944006 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 23:25:09.525721 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2396 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 23:25:09.530956 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:09.541587 tst emergency:oc2g: Using 1 x bts (candidates: 1) 23:25:09.576622 tst emergency_mo_mt_call.py: using LAC 36951 23:25:09.692251 tst emergency_mo_mt_call.py: using RAC 231 23:25:09.806813 tst emergency_mo_mt_call.py: using CellId 36951 23:25:09.923268 tst emergency_mo_mt_call.py: using BVCI 36952 23:25:10.029116 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:10.039980 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:10.050388 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:10.060639 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:10.071034 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:10.081314 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:10.199951 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:10.314733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:10.768906 run create_hlr_db(pid=12940): Launched 23:25:10.888251 bus /sierra_2: Setting Powered False 23:25:11.951367 run create_hlr_db(pid=12940): Terminated: ok {rc=0} 23:25:12.372274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12942): Launched 23:25:12.664158 run osmo-hlr_10.42.42.2(pid=12943): Launched 23:25:12.776626 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:13.280561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12945): Launched 23:25:13.573062 run osmo-stp_10.42.42.5(pid=12946): Launched 23:25:13.694778 tst emergency_mo_mt_call.py: using MSISDN 8387 23:25:13.848233 run osmo-msc_10.42.42.6: Starting osmo-msc 23:25:14.374494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12948): Launched 23:25:14.666804 run osmo-msc_10.42.42.6(pid=12949): Launched 23:25:14.831864 run osmo-stp_10.42.42.5(pid=12946): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12946)] 23:25:14.955340 run osmo-stp_10.42.42.5(pid=12946): stdout: | (launched: 2022-12-13_23:25:13.519683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:15.079465 run osmo-stp_10.42.42.5(pid=12946): stderr: | [0;m[38;5;43m20221213232513689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232513689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232513689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232513690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232513690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232513690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232513690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:15.202518 run osmo-stp_10.42.42.5(pid=12946): stdout: | (launched: 2022-12-13_23:25:13.519683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:15.319378 run osmo-stp_10.42.42.5(pid=12946): stderr: | [0;m[38;5;43m20221213232513689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232513689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232513689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232513690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232513690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232513690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232513690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:15.459853 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12946): Process ended prematurely: osmo-stp_10.42.42.5(pid=12946) [trial-2396↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12946)] [trial-2396↪emergency:oc2g↪emergency_mo_mt_call.py:19] 23:25:15.468175 tst emergency_mo_mt_call.py:19: Test FAILED (5.9 sec) 23:25:15.494160 run osmo-hlr_10.42.42.2(pid=12943): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12943)] 23:25:15.542219 run osmo-hlr_10.42.42.2(pid=12943): stdout: | (launched: 2022-12-13_23:25:12.610608) 23:25:15.591678 run osmo-hlr_10.42.42.2(pid=12943): stderr: | [0;m[1;31m20221213232512787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232512787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232512787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232512787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232512787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232512787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232512800 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232512810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232512810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232512810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:15.660788 run osmo-msc_10.42.42.6(pid=12949): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12949)] 23:25:15.708350 run osmo-msc_10.42.42.6(pid=12949): stdout: | (launched: 2022-12-13_23:25:14.613161) 23:25:15.757217 run osmo-msc_10.42.42.6(pid=12949): stderr: | [0;m[38;5;43m20221213232514883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232514883 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5a243c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232514883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232514883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232514884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232514884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232514886 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232514886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232514886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232514886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:25:15.806600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12942): Terminating (SIGTERM) 23:25:15.846647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12945): Terminating (SIGTERM) 23:25:15.897658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12948): Terminating (SIGTERM) 23:25:15.949721 --- ParallelTerminationStrategy: PID 12942 died... 23:25:15.971804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12942): Terminated: ok {rc=0} 23:25:16.022177 --- ParallelTerminationStrategy: PID 12945 died... 23:25:16.043998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12945): Terminated: ok {rc=0} 23:25:16.092835 --- ParallelTerminationStrategy: PID 12948 died... 23:25:16.115604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12948): Terminated: ok {rc=0} 23:25:16.208781 bus /sierra_3: Setting Powered False 23:25:17.309339 bus /sierra_3: Setting Powered False 23:25:18.424769 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 23:25:19.510630 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:19.522479 tst emergency:oc2g: Using 1 x bts (candidates: 1) 23:25:19.563926 tst emergency_preemptive_call.py: using LAC 36952 23:25:19.689386 tst emergency_preemptive_call.py: using RAC 232 23:25:19.811137 tst emergency_preemptive_call.py: using CellId 36952 23:25:19.934499 tst emergency_preemptive_call.py: using BVCI 36953 23:25:20.049283 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:20.060443 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:20.071558 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:20.082715 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:20.094294 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:20.106088 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:20.227372 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:20.342801 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:20.462337 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:20.579610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:21.068721 run create_hlr_db(pid=12951): Launched 23:25:21.189188 bus /sierra_2: Setting Powered False 23:25:22.252073 run create_hlr_db(pid=12951): Terminated: ok {rc=0} 23:25:22.692602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12953): Launched 23:25:23.006881 run osmo-hlr_10.42.42.2(pid=12954): Launched 23:25:23.127269 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:23.672278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12956): Launched 23:25:23.986962 run osmo-stp_10.42.42.5(pid=12957): Launched 23:25:24.121681 tst emergency_preemptive_call.py: using MSISDN 8388 23:25:24.284493 run osmo-msc_10.42.42.6: Starting osmo-msc 23:25:24.849466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12959): Launched 23:25:25.164389 run osmo-msc_10.42.42.6(pid=12960): Launched 23:25:25.341222 run osmo-stp_10.42.42.5(pid=12957): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12957)] 23:25:25.475121 run osmo-stp_10.42.42.5(pid=12957): stdout: | (launched: 2022-12-13_23:25:23.929763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:25.609506 run osmo-stp_10.42.42.5(pid=12957): stderr: | [0;m[38;5;43m20221213232524120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232524120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232524121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232524121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232524122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232524122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232524122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:25.743286 run osmo-stp_10.42.42.5(pid=12957): stdout: | (launched: 2022-12-13_23:25:23.929763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:25.869377 run osmo-stp_10.42.42.5(pid=12957): stderr: | [0;m[38;5;43m20221213232524120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232524120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232524121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232524121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232524122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232524122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232524122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:26.019914 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12957): Process ended prematurely: osmo-stp_10.42.42.5(pid=12957) [trial-2396↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12957)] [trial-2396↪emergency:oc2g↪emergency_preemptive_call.py:32] 23:25:26.028766 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 23:25:26.056044 run osmo-hlr_10.42.42.2(pid=12954): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12954)] 23:25:26.106547 run osmo-hlr_10.42.42.2(pid=12954): stdout: | (launched: 2022-12-13_23:25:22.949885) 23:25:26.158010 run osmo-hlr_10.42.42.2(pid=12954): stderr: | [0;m[1;31m20221213232523147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232523147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232523148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232523148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232523148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232523148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232523160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232523168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232523168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232523168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:26.230238 run osmo-msc_10.42.42.6(pid=12960): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12960)] 23:25:26.279953 run osmo-msc_10.42.42.6(pid=12960): stdout: | (launched: 2022-12-13_23:25:25.106806) 23:25:26.331310 run osmo-msc_10.42.42.6(pid=12960): stderr: | [0;m[38;5;43m20221213232525429 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213232525429 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1127286c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213232525429 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213232525429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213232525430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213232525430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213232525432 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213232525432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213232525432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213232525432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:25:26.383217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12953): Terminating (SIGTERM) 23:25:26.424447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12956): Terminating (SIGTERM) 23:25:26.466617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12959): Terminating (SIGTERM) 23:25:26.508588 --- ParallelTerminationStrategy: PID 12953 died... 23:25:26.529122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12953): Terminated: ok {rc=0} 23:25:26.575425 --- ParallelTerminationStrategy: PID 12956 died... 23:25:26.595199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12956): Terminated: ok {rc=0} 23:25:26.641593 --- ParallelTerminationStrategy: PID 12959 died... 23:25:26.661524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12959): Terminated: ok {rc=0} 23:25:26.750350 bus /sierra_9: Setting Powered False 23:25:27.849522 bus /sierra_9: Setting Powered False 23:25:28.967113 bus /sierra_8: Setting Powered False 23:25:30.064643 bus /sierra_8: Setting Powered False 23:25:31.205683 bus /sierra_3: Setting Powered False 23:25:32.323087 bus /sierra_3: Setting Powered False 23:25:33.441347 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:oc2g --------------------------------------------------------------------- 23:25:34.700399 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:25:34.704541 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 23:25:34.724635 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 23:25:34.762719 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 23:25:34.849193 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 23:25:34.870193 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 23:25:34.908240 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 23:25:35.500337 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 23:25:35.550458 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:35.560787 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:25:35.594016 tst cs_paging_gprs_active.py: using LAC 36953 23:25:35.711898 tst cs_paging_gprs_active.py: using RAC 233 23:25:35.828066 tst cs_paging_gprs_active.py: using CellId 36953 23:25:35.955411 tst cs_paging_gprs_active.py: using BVCI 36954 23:25:36.065530 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:36.076156 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:36.086618 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:36.096898 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:36.107315 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:36.118020 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:36.128371 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:36.138766 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:36.149253 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:36.269034 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:36.385464 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:25:36.586640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:36.886320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12967): Launched 23:25:37.145570 run iperf3-srv_10.42.42.10(pid=12968): Launched 23:25:37.257256 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:25:37.457509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:37.756611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12969): Launched 23:25:38.016346 run iperf3-srv_10.42.42.10(pid=12970): Launched 23:25:38.128023 tst cs_paging_gprs_active.py:38: start network... 23:25:38.327978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:38.788614 run create_hlr_db(pid=12971): Launched 23:25:38.910744 bus /sierra_2: Setting Powered False 23:25:39.971232 run create_hlr_db(pid=12971): Terminated: ok {rc=0} 23:25:40.405891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12973): Launched 23:25:40.727086 run osmo-hlr_10.42.42.2(pid=12974): Launched 23:25:40.849407 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:41.401647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12976): Launched 23:25:41.721146 run osmo-stp_10.42.42.5(pid=12977): Launched 23:25:41.843850 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:25:42.395909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12979): Launched 23:25:42.519150 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:25:42.791653 run patchelf(pid=12980): Launched 23:25:42.969844 run osmo-stp_10.42.42.5(pid=12977): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12977)] 23:25:43.105447 run osmo-stp_10.42.42.5(pid=12977): stdout: | (launched: 2022-12-13_23:25:41.663347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:43.242729 run osmo-stp_10.42.42.5(pid=12977): stderr: | [0;m[38;5;43m20221213232541856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232541856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232541857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232541857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232541858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232541858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232541858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:43.380344 run osmo-stp_10.42.42.5(pid=12977): stdout: | (launched: 2022-12-13_23:25:41.663347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:43.511703 run osmo-stp_10.42.42.5(pid=12977): stderr: | [0;m[38;5;43m20221213232541856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232541856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232541857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232541857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232541858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232541858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232541858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:43.668167 run patchelf(pid=12980): Terminating (SIGINT) 23:25:43.848280 run patchelf(pid=12980): Terminated: ok {rc=0} 23:25:43.978323 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12977): Process ended prematurely: osmo-stp_10.42.42.5(pid=12977) [trial-2396↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12977)] [trial-2396↪gprs:oc2g↪cs_paging_gprs_active.py:38] 23:25:43.988182 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:25:44.016638 run osmo-hlr_10.42.42.2(pid=12974): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12974)] 23:25:44.067010 run osmo-hlr_10.42.42.2(pid=12974): stdout: | (launched: 2022-12-13_23:25:40.669229) 23:25:44.119102 run osmo-hlr_10.42.42.2(pid=12974): stderr: | [0;m[1;31m20221213232540869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232540869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232540869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232540869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232540869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232540869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232540882 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232540891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232540892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232540892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:44.171155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12967): Terminating (SIGTERM) 23:25:44.212472 run iperf3-srv_10.42.42.10(pid=12968): Terminating (SIGTERM) 23:25:44.254503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12969): Terminating (SIGTERM) 23:25:44.296156 run iperf3-srv_10.42.42.10(pid=12970): Terminating (SIGTERM) 23:25:44.338181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12973): Terminating (SIGTERM) 23:25:44.380016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12976): Terminating (SIGTERM) 23:25:44.422080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12979): Terminating (SIGTERM) 23:25:44.464143 --- ParallelTerminationStrategy: PID 12967 died... 23:25:44.484568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12967): Terminated: ok {rc=0} 23:25:44.530783 --- ParallelTerminationStrategy: PID 12968 died... 23:25:44.550595 run iperf3-srv_10.42.42.10(pid=12968): Terminated {rc=256} 23:25:44.596297 --- ParallelTerminationStrategy: PID 12969 died... 23:25:44.616082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12969): Terminated: ok {rc=0} 23:25:44.662478 --- ParallelTerminationStrategy: PID 12970 died... 23:25:44.682572 run iperf3-srv_10.42.42.10(pid=12970): Terminated {rc=256} 23:25:44.728517 --- ParallelTerminationStrategy: PID 12973 died... 23:25:44.748460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12973): Terminated: ok {rc=0} 23:25:44.794322 --- ParallelTerminationStrategy: PID 12976 died... 23:25:44.814100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12976): Terminated: ok {rc=0} 23:25:44.859912 --- ParallelTerminationStrategy: PID 12979 died... 23:25:44.879764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12979): Terminated: ok {rc=0} 23:25:44.966596 bus /gobi_0: Setting Powered False 23:25:46.065866 bus /gobi_0: Setting Powered False 23:25:47.206048 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g iperf3.py ---------------------------------------------- 23:25:48.357194 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:48.368707 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:25:48.405226 tst iperf3.py: using LAC 36954 23:25:48.530059 tst iperf3.py: using RAC 234 23:25:48.655291 tst iperf3.py: using CellId 36954 23:25:48.774522 tst iperf3.py: using BVCI 36955 23:25:48.882542 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:48.893213 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:48.903820 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:48.914270 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:48.924528 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:48.934767 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:48.945025 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:48.955289 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:48.966227 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:49.081400 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:25:49.282016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:49.581610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12982): Launched 23:25:49.841696 run iperf3-srv_10.42.42.10(pid=12983): Launched 23:25:49.953660 tst iperf3.py:8: start network... 23:25:50.154155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:50.616474 run create_hlr_db(pid=12984): Launched 23:25:50.738356 bus /gobi_6: Setting Powered False 23:25:51.798565 run create_hlr_db(pid=12984): Terminated: ok {rc=0} 23:25:52.225093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12987): Launched 23:25:52.523043 run osmo-hlr_10.42.42.2(pid=12988): Launched 23:25:52.636106 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:53.164296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12990): Launched 23:25:53.462943 run osmo-stp_10.42.42.5(pid=12991): Launched 23:25:53.577142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:25:54.092740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12993): Launched 23:25:54.206611 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:25:54.458129 run patchelf(pid=12994): Launched 23:25:54.623440 run osmo-stp_10.42.42.5(pid=12991): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12991)] 23:25:54.749155 run osmo-stp_10.42.42.5(pid=12991): stdout: | (launched: 2022-12-13_23:25:53.408344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:54.876514 run osmo-stp_10.42.42.5(pid=12991): stderr: | [0;m[38;5;43m20221213232553578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232553578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232553578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232553579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232553581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232553581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232553581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:55.004558 run osmo-stp_10.42.42.5(pid=12991): stdout: | (launched: 2022-12-13_23:25:53.408344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:55.126533 run osmo-stp_10.42.42.5(pid=12991): stderr: | [0;m[38;5;43m20221213232553578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232553578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232553578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232553579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232553581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232553581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232553581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:55.270984 run patchelf(pid=12994): Terminating (SIGINT) 23:25:55.438806 run patchelf(pid=12994): Terminated: ok {rc=0} 23:25:55.559080 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12991): Process ended prematurely: osmo-stp_10.42.42.5(pid=12991) [trial-2396↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12991)] [trial-2396↪gprs:oc2g↪iperf3.py:8] 23:25:55.568325 tst iperf3.py:8: Test FAILED (7.3 sec) 23:25:55.595096 run osmo-hlr_10.42.42.2(pid=12988): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12988)] 23:25:55.642132 run osmo-hlr_10.42.42.2(pid=12988): stdout: | (launched: 2022-12-13_23:25:52.468409) 23:25:55.690810 run osmo-hlr_10.42.42.2(pid=12988): stderr: | [0;m[1;31m20221213232552642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232552643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232552643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232552643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232552643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232552643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232552655 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232552666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232552667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232552667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:55.740043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12982): Terminating (SIGTERM) 23:25:55.779267 run iperf3-srv_10.42.42.10(pid=12983): Terminating (SIGTERM) 23:25:55.818407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12987): Terminating (SIGTERM) 23:25:55.857584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12990): Terminating (SIGTERM) 23:25:55.897256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12993): Terminating (SIGTERM) 23:25:55.936732 --- ParallelTerminationStrategy: PID 12982 died... 23:25:55.955186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12982): Terminated: ok {rc=0} 23:25:55.998445 --- ParallelTerminationStrategy: PID 12983 died... 23:25:56.016787 run iperf3-srv_10.42.42.10(pid=12983): Terminated {rc=256} 23:25:56.059862 --- ParallelTerminationStrategy: PID 12987 died... 23:25:56.078303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12987): Terminated: ok {rc=0} 23:25:56.121497 --- ParallelTerminationStrategy: PID 12990 died... 23:25:56.139851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12990): Terminated: ok {rc=0} 23:25:56.182923 --- ParallelTerminationStrategy: PID 12993 died... 23:25:56.201333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12993): Terminated: ok {rc=0} 23:25:56.283587 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g iperf3m4.py ---------------------------------------------- 23:25:57.431748 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:57.443573 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:25:57.482235 tst iperf3m4.py: using LAC 36955 23:25:57.609452 tst iperf3m4.py: using RAC 235 23:25:57.734770 tst iperf3m4.py: using CellId 36955 23:25:57.861740 tst iperf3m4.py: using BVCI 36956 23:25:57.978174 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:57.989189 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:57.999962 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:58.010863 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:58.021929 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:58.032839 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:58.044073 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:58.055131 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:58.066391 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:58.183177 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:58.301796 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:58.418023 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:58.531217 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:25:58.732606 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:59.033676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12995): Launched 23:25:59.293535 run iperf3-srv_10.42.42.10(pid=12996): Launched 23:25:59.404814 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:25:59.605424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:59.903822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12997): Launched 23:26:00.162460 run iperf3-srv_10.42.42.10(pid=12998): Launched 23:26:00.273893 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:26:00.473316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:00.772105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12999): Launched 23:26:01.088876 run iperf3-srv_10.42.42.10(pid=13000): Launched 23:26:01.212056 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:26:01.415385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:01.727452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13001): Launched 23:26:02.016296 run iperf3-srv_10.42.42.10(pid=13002): Launched 23:26:02.135150 tst iperf3m4.py:8: start network... 23:26:02.337277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:02.800865 run create_hlr_db(pid=13003): Launched 23:26:02.925528 bus /gobi_6: Setting Powered False 23:26:03.989871 run create_hlr_db(pid=13003): Terminated: ok {rc=0} 23:26:04.436076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13005): Launched 23:26:04.757116 run osmo-hlr_10.42.42.2(pid=13006): Launched 23:26:04.879538 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:05.431114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13008): Launched 23:26:05.752122 run osmo-stp_10.42.42.5(pid=13009): Launched 23:26:05.874987 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:06.428461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13011): Launched 23:26:06.550989 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:06.822300 run patchelf(pid=13012): Launched 23:26:07.000397 run osmo-stp_10.42.42.5(pid=13009): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13009)] 23:26:07.135722 run osmo-stp_10.42.42.5(pid=13009): stdout: | (launched: 2022-12-13_23:26:05.694003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:07.273248 run osmo-stp_10.42.42.5(pid=13009): stderr: | [0;m[38;5;43m20221213232605887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232605887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232605887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232605887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232605888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232605888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232605888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:07.411347 run osmo-stp_10.42.42.5(pid=13009): stdout: | (launched: 2022-12-13_23:26:05.694003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:07.543298 run osmo-stp_10.42.42.5(pid=13009): stderr: | [0;m[38;5;43m20221213232605887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232605887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232605887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232605887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232605888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232605888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232605888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:07.699417 run patchelf(pid=13012): Terminating (SIGINT) 23:26:07.879739 run patchelf(pid=13012): Terminated: ok {rc=0} 23:26:08.009656 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13009): Process ended prematurely: osmo-stp_10.42.42.5(pid=13009) [trial-2396↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13009)] [trial-2396↪gprs:oc2g↪iperf3m4.py:8] 23:26:08.019554 tst iperf3m4.py:8: Test FAILED (10.6 sec) 23:26:08.048007 run osmo-hlr_10.42.42.2(pid=13006): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13006)] 23:26:08.098564 run osmo-hlr_10.42.42.2(pid=13006): stdout: | (launched: 2022-12-13_23:26:04.698368) 23:26:08.150595 run osmo-hlr_10.42.42.2(pid=13006): stderr: | [0;m[1;31m20221213232604897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232604897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232604897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232604897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232604897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232604897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232604921 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232604930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232604931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232604931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:08.202153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12995): Terminating (SIGTERM) 23:26:08.243576 run iperf3-srv_10.42.42.10(pid=12996): Terminating (SIGTERM) 23:26:08.284528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12997): Terminating (SIGTERM) 23:26:08.325931 run iperf3-srv_10.42.42.10(pid=12998): Terminating (SIGTERM) 23:26:08.367124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12999): Terminating (SIGTERM) 23:26:08.408923 run iperf3-srv_10.42.42.10(pid=13000): Terminating (SIGTERM) 23:26:08.450428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13001): Terminating (SIGTERM) 23:26:08.492221 run iperf3-srv_10.42.42.10(pid=13002): Terminating (SIGTERM) 23:26:08.533777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13005): Terminating (SIGTERM) 23:26:08.575723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13008): Terminating (SIGTERM) 23:26:08.617081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13011): Terminating (SIGTERM) 23:26:08.658543 --- ParallelTerminationStrategy: PID 12995 died... 23:26:08.678908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12995): Terminated: ok {rc=0} 23:26:08.724747 --- ParallelTerminationStrategy: PID 12996 died... 23:26:08.744396 run iperf3-srv_10.42.42.10(pid=12996): Terminated {rc=256} 23:26:08.789843 --- ParallelTerminationStrategy: PID 12997 died... 23:26:08.809499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12997): Terminated: ok {rc=0} 23:26:08.854812 --- ParallelTerminationStrategy: PID 12998 died... 23:26:08.874291 run iperf3-srv_10.42.42.10(pid=12998): Terminated {rc=256} 23:26:08.919446 --- ParallelTerminationStrategy: PID 12999 died... 23:26:08.939026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12999): Terminated: ok {rc=0} 23:26:08.984409 --- ParallelTerminationStrategy: PID 13000 died... 23:26:09.003892 run iperf3-srv_10.42.42.10(pid=13000): Terminated {rc=256} 23:26:09.049439 --- ParallelTerminationStrategy: PID 13001 died... 23:26:09.069007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13001): Terminated: ok {rc=0} 23:26:09.114593 --- ParallelTerminationStrategy: PID 13002 died... 23:26:09.134233 run iperf3-srv_10.42.42.10(pid=13002): Terminated {rc=256} 23:26:09.179782 --- ParallelTerminationStrategy: PID 13005 died... 23:26:09.199443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13005): Terminated: ok {rc=0} 23:26:09.245123 --- ParallelTerminationStrategy: PID 13008 died... 23:26:09.264685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13008): Terminated: ok {rc=0} 23:26:09.310148 --- ParallelTerminationStrategy: PID 13011 died... 23:26:09.329854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13011): Terminated: ok {rc=0} 23:26:09.416894 bus /gobi_4: Setting Powered False 23:26:10.514594 bus /gobi_4: Setting Powered False 23:26:11.629121 bus /gobi_1: Setting Powered False 23:26:12.725784 bus /gobi_1: Setting Powered False 23:26:13.839971 bus /gobi_0: Setting Powered False 23:26:14.936047 bus /gobi_0: Setting Powered False 23:26:16.078359 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g ping.py ---------------------------------------------- 23:26:17.181423 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.193128 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:26:17.227659 tst ping.py: using LAC 36956 23:26:17.344137 tst ping.py: using RAC 236 23:26:17.458425 tst ping.py: using CellId 36956 23:26:17.574721 tst ping.py: using BVCI 36957 23:26:17.681468 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.692083 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.702576 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.712931 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.723233 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.733610 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.744679 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.755202 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:26:17.868675 tst ping.py:19: start network... 23:26:18.067079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:18.520816 run create_hlr_db(pid=13013): Launched 23:26:18.640566 bus /gobi_6: Setting Powered False 23:26:19.700126 run create_hlr_db(pid=13013): Terminated: ok {rc=0} 23:26:20.129803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13015): Launched 23:26:20.443599 run osmo-hlr_10.42.42.2(pid=13016): Launched 23:26:20.564125 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:21.110925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13018): Launched 23:26:21.425037 run osmo-stp_10.42.42.5(pid=13019): Launched 23:26:21.545871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:22.090798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13021): Launched 23:26:22.211123 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:22.477665 run patchelf(pid=13022): Launched 23:26:22.652818 run osmo-stp_10.42.42.5(pid=13019): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13019)] 23:26:22.787045 run osmo-stp_10.42.42.5(pid=13019): stdout: | (launched: 2022-12-13_23:26:21.367870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:22.922542 run osmo-stp_10.42.42.5(pid=13019): stderr: | [0;m[38;5;43m20221213232621559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232621559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232621560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232621560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232621561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232621561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232621561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:23.057554 run osmo-stp_10.42.42.5(pid=13019): stdout: | (launched: 2022-12-13_23:26:21.367870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:23.187348 run osmo-stp_10.42.42.5(pid=13019): stderr: | [0;m[38;5;43m20221213232621559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232621559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232621560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232621560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232621561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232621561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232621561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:23.340774 run patchelf(pid=13022): Terminating (SIGINT) 23:26:23.517965 run patchelf(pid=13022): Terminated: ok {rc=0} 23:26:23.645947 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13019): Process ended prematurely: osmo-stp_10.42.42.5(pid=13019) [trial-2396↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13019)] [trial-2396↪gprs:oc2g↪ping.py:22] 23:26:23.655367 tst ping.py:22: Test FAILED (6.5 sec) 23:26:23.683969 run osmo-hlr_10.42.42.2(pid=13016): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13016)] 23:26:23.735035 run osmo-hlr_10.42.42.2(pid=13016): stdout: | (launched: 2022-12-13_23:26:20.386397) 23:26:23.787748 run osmo-hlr_10.42.42.2(pid=13016): stderr: | [0;m[1;31m20221213232620584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232620585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232620585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232620585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232620585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232620585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232620598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232620608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232620609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232620609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:23.840496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13015): Terminating (SIGTERM) 23:26:23.882662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13018): Terminating (SIGTERM) 23:26:23.924642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13021): Terminating (SIGTERM) 23:26:23.967359 --- ParallelTerminationStrategy: PID 13015 died... 23:26:23.987733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13015): Terminated: ok {rc=0} 23:26:24.034307 --- ParallelTerminationStrategy: PID 13018 died... 23:26:24.054424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13018): Terminated: ok {rc=0} 23:26:24.100842 --- ParallelTerminationStrategy: PID 13021 died... 23:26:24.121251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13021): Terminated: ok {rc=0} 23:26:24.208829 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 23:26:25.295044 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.306482 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:26:25.342589 tst ping_idle_ping.py: using LAC 36957 23:26:25.471614 tst ping_idle_ping.py: using RAC 237 23:26:25.595648 tst ping_idle_ping.py: using CellId 36957 23:26:25.721379 tst ping_idle_ping.py: using BVCI 36958 23:26:25.838250 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.849249 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.860011 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.870809 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.882276 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.893992 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.905614 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.917235 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:26:26.033101 tst ping_idle_ping.py:24: start network... 23:26:26.230728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:26.689327 run create_hlr_db(pid=13023): Launched 23:26:26.809892 bus /gobi_6: Setting Powered False 23:26:27.869129 run create_hlr_db(pid=13023): Terminated: ok {rc=0} 23:26:28.300584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13025): Launched 23:26:28.616247 run osmo-hlr_10.42.42.2(pid=13026): Launched 23:26:28.737403 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:29.248733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13028): Launched 23:26:29.542999 run osmo-stp_10.42.42.5(pid=13029): Launched 23:26:29.655079 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:30.162483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13031): Launched 23:26:30.274387 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:30.522290 run patchelf(pid=13032): Launched 23:26:30.685490 run osmo-stp_10.42.42.5(pid=13029): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13029)] 23:26:30.809739 run osmo-stp_10.42.42.5(pid=13029): stdout: | (launched: 2022-12-13_23:26:29.489066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:30.956363 run osmo-stp_10.42.42.5(pid=13029): stderr: | [0;m[38;5;43m20221213232629657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232629657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232629658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232629658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232629658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232629659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232629659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:31.084088 run osmo-stp_10.42.42.5(pid=13029): stdout: | (launched: 2022-12-13_23:26:29.489066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:31.207579 run osmo-stp_10.42.42.5(pid=13029): stderr: | [0;m[38;5;43m20221213232629657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232629657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232629658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232629658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232629658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232629659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232629659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:31.353343 run patchelf(pid=13032): Terminating (SIGINT) 23:26:31.522054 run patchelf(pid=13032): Terminated: ok {rc=0} 23:26:31.643803 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13029): Process ended prematurely: osmo-stp_10.42.42.5(pid=13029) [trial-2396↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13029)] [trial-2396↪gprs:oc2g↪ping_idle_ping.py:27] 23:26:31.653259 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 23:26:31.680505 run osmo-hlr_10.42.42.2(pid=13026): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13026)] 23:26:31.729721 run osmo-hlr_10.42.42.2(pid=13026): stdout: | (launched: 2022-12-13_23:26:28.558906) 23:26:31.779433 run osmo-hlr_10.42.42.2(pid=13026): stderr: | [0;m[1;31m20221213232628758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232628758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232628758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232628758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232628758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232628758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232628771 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232628781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232628781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232628781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:31.829726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13025): Terminating (SIGTERM) 23:26:31.870479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13028): Terminating (SIGTERM) 23:26:31.912520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13031): Terminating (SIGTERM) 23:26:31.954056 --- ParallelTerminationStrategy: PID 13025 died... 23:26:31.973300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13025): Terminated: ok {rc=0} 23:26:32.019939 --- ParallelTerminationStrategy: PID 13028 died... 23:26:32.038968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13028): Terminated: ok {rc=0} 23:26:32.083622 --- ParallelTerminationStrategy: PID 13031 died... 23:26:32.103030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13031): Terminated: ok {rc=0} 23:26:32.188418 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 23:26:33.474691 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:26:33.479821 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:26:33.499815 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:26:33.537694 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:26:33.622512 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:26:33.642424 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:26:33.679796 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:26:34.272030 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:26:34.319210 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.329766 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:26:34.366656 tst cs_paging_gprs_active.py: using LAC 36958 23:26:34.483637 tst cs_paging_gprs_active.py: using RAC 238 23:26:34.601034 tst cs_paging_gprs_active.py: using CellId 36958 23:26:34.716330 tst cs_paging_gprs_active.py: using BVCI 36959 23:26:34.822610 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.833309 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.843701 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.854068 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.864290 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.875080 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.885654 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.895939 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.906871 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:35.026816 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:35.141699 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:26:35.339416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:35.633477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13036): Launched 23:26:35.889306 run iperf3-srv_10.42.42.10(pid=13037): Launched 23:26:35.998747 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:26:36.194803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:36.488467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13038): Launched 23:26:36.744646 run iperf3-srv_10.42.42.10(pid=13039): Launched 23:26:36.854306 tst cs_paging_gprs_active.py:38: start network... 23:26:37.050754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:37.507373 run create_hlr_db(pid=13040): Launched 23:26:37.626920 bus /gobi_6: Setting Powered False 23:26:38.686107 run create_hlr_db(pid=13040): Terminated: ok {rc=0} 23:26:39.114758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13042): Launched 23:26:39.427857 run osmo-hlr_10.42.42.2(pid=13043): Launched 23:26:39.548588 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:40.091878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13045): Launched 23:26:40.406470 run osmo-stp_10.42.42.5(pid=13046): Launched 23:26:40.527141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:41.069877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13048): Launched 23:26:41.190095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:41.455856 run patchelf(pid=13049): Launched 23:26:41.630912 run osmo-stp_10.42.42.5(pid=13046): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13046)] 23:26:41.765277 run osmo-stp_10.42.42.5(pid=13046): stdout: | (launched: 2022-12-13_23:26:40.349975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:41.901178 run osmo-stp_10.42.42.5(pid=13046): stderr: | [0;m[38;5;43m20221213232640540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232640540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232640540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232640541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232640541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232640541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232640541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:42.037140 run osmo-stp_10.42.42.5(pid=13046): stdout: | (launched: 2022-12-13_23:26:40.349975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:42.166906 run osmo-stp_10.42.42.5(pid=13046): stderr: | [0;m[38;5;43m20221213232640540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232640540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232640540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232640541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232640541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232640541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232640541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:42.320497 run patchelf(pid=13049): Terminating (SIGINT) 23:26:42.497925 run patchelf(pid=13049): Terminated: ok {rc=0} 23:26:42.625509 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13046): Process ended prematurely: osmo-stp_10.42.42.5(pid=13046) [trial-2396↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13046)] [trial-2396↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:26:42.635448 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 23:26:42.663426 run osmo-hlr_10.42.42.2(pid=13043): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13043)] 23:26:42.713952 run osmo-hlr_10.42.42.2(pid=13043): stdout: | (launched: 2022-12-13_23:26:39.371332) 23:26:42.765605 run osmo-hlr_10.42.42.2(pid=13043): stderr: | [0;m[1;31m20221213232639569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232639569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232639569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232639569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232639569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232639569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232639581 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232639589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232639589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232639590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:42.817457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13036): Terminating (SIGTERM) 23:26:42.859380 run iperf3-srv_10.42.42.10(pid=13037): Terminating (SIGTERM) 23:26:42.901160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13038): Terminating (SIGTERM) 23:26:42.942872 run iperf3-srv_10.42.42.10(pid=13039): Terminating (SIGTERM) 23:26:42.984892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13042): Terminating (SIGTERM) 23:26:43.026931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13045): Terminating (SIGTERM) 23:26:43.068320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13048): Terminating (SIGTERM) 23:26:43.110271 --- ParallelTerminationStrategy: PID 13036 died... 23:26:43.130446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13036): Terminated: ok {rc=0} 23:26:43.176841 --- ParallelTerminationStrategy: PID 13037 died... 23:26:43.196398 run iperf3-srv_10.42.42.10(pid=13037): Terminated {rc=256} 23:26:43.242292 --- ParallelTerminationStrategy: PID 13038 died... 23:26:43.262089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13038): Terminated: ok {rc=0} 23:26:43.308111 --- ParallelTerminationStrategy: PID 13039 died... 23:26:43.327744 run iperf3-srv_10.42.42.10(pid=13039): Terminated {rc=256} 23:26:43.373631 --- ParallelTerminationStrategy: PID 13042 died... 23:26:43.393283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13042): Terminated: ok {rc=0} 23:26:43.439156 --- ParallelTerminationStrategy: PID 13045 died... 23:26:43.458745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13045): Terminated: ok {rc=0} 23:26:43.504502 --- ParallelTerminationStrategy: PID 13048 died... 23:26:43.524282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13048): Terminated: ok {rc=0} 23:26:43.611799 bus /gobi_0: Setting Powered False 23:26:44.710073 bus /gobi_0: Setting Powered False 23:26:45.825102 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:26:46.971880 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:46.984419 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:26:47.022128 tst iperf3.py: using LAC 36959 23:26:47.149492 tst iperf3.py: using RAC 239 23:26:47.272800 tst iperf3.py: using CellId 36959 23:26:47.392603 tst iperf3.py: using BVCI 36960 23:26:47.501852 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.512578 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.523368 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.534107 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.544872 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.556026 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.567240 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.578371 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.590033 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:47.710364 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:26:47.923001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:48.238235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13050): Launched 23:26:48.513293 run iperf3-srv_10.42.42.10(pid=13051): Launched 23:26:48.631649 tst iperf3.py:8: start network... 23:26:48.844387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:49.331244 run create_hlr_db(pid=13052): Launched 23:26:49.450856 bus /gobi_6: Setting Powered False 23:26:50.513116 run create_hlr_db(pid=13052): Terminated: ok {rc=0} 23:26:50.933445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13054): Launched 23:26:51.247847 run osmo-hlr_10.42.42.2(pid=13055): Launched 23:26:51.367985 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:51.908801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13057): Launched 23:26:52.223941 run osmo-stp_10.42.42.5(pid=13058): Launched 23:26:52.344414 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:52.887249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13060): Launched 23:26:53.007415 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:53.272861 run patchelf(pid=13061): Launched 23:26:53.447653 run osmo-stp_10.42.42.5(pid=13058): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13058)] 23:26:53.581632 run osmo-stp_10.42.42.5(pid=13058): stdout: | (launched: 2022-12-13_23:26:52.167124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:53.717641 run osmo-stp_10.42.42.5(pid=13058): stderr: | [0;m[38;5;43m20221213232652358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232652358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232652358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232652358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232652359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232652359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232652359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:53.853215 run osmo-stp_10.42.42.5(pid=13058): stdout: | (launched: 2022-12-13_23:26:52.167124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:53.983016 run osmo-stp_10.42.42.5(pid=13058): stderr: | [0;m[38;5;43m20221213232652358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232652358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232652358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232652358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232652359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232652359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232652359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:54.136399 run patchelf(pid=13061): Terminating (SIGINT) 23:26:54.313804 run patchelf(pid=13061): Terminated: ok {rc=0} 23:26:54.441614 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13058): Process ended prematurely: osmo-stp_10.42.42.5(pid=13058) [trial-2396↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13058)] [trial-2396↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 23:26:54.451606 tst iperf3.py:8: Test FAILED (7.5 sec) 23:26:54.479749 run osmo-hlr_10.42.42.2(pid=13055): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13055)] 23:26:54.530534 run osmo-hlr_10.42.42.2(pid=13055): stdout: | (launched: 2022-12-13_23:26:51.191258) 23:26:54.582773 run osmo-hlr_10.42.42.2(pid=13055): stderr: | [0;m[1;31m20221213232651387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232651387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232651387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232651387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232651387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232651387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232651445 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232651455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232651455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232651455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:54.635399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13050): Terminating (SIGTERM) 23:26:54.676830 run iperf3-srv_10.42.42.10(pid=13051): Terminating (SIGTERM) 23:26:54.719526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13054): Terminating (SIGTERM) 23:26:54.762247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13057): Terminating (SIGTERM) 23:26:54.804326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13060): Terminating (SIGTERM) 23:26:54.846478 --- ParallelTerminationStrategy: PID 13050 died... 23:26:54.866731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13050): Terminated: ok {rc=0} 23:26:54.913124 --- ParallelTerminationStrategy: PID 13051 died... 23:26:54.932746 run iperf3-srv_10.42.42.10(pid=13051): Terminated {rc=256} 23:26:54.978879 --- ParallelTerminationStrategy: PID 13054 died... 23:26:54.998707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13054): Terminated: ok {rc=0} 23:26:55.045114 --- ParallelTerminationStrategy: PID 13057 died... 23:26:55.064919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13057): Terminated: ok {rc=0} 23:26:55.111344 --- ParallelTerminationStrategy: PID 13060 died... 23:26:55.131164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13060): Terminated: ok {rc=0} 23:26:55.219630 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:26:56.367795 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.379458 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:26:56.419582 tst iperf3m4.py: using LAC 36960 23:26:56.544408 tst iperf3m4.py: using RAC 240 23:26:56.669216 tst iperf3m4.py: using CellId 36960 23:26:56.793607 tst iperf3m4.py: using BVCI 36961 23:26:56.902138 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.913138 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.923782 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.934564 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.945193 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.956279 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.967322 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.978149 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.989027 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:57.108245 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:57.223498 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:57.344860 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:57.464700 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:26:57.677461 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:57.994189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13062): Launched 23:26:58.268371 run iperf3-srv_10.42.42.10(pid=13063): Launched 23:26:58.387187 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:26:58.599515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:58.916155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13064): Launched 23:26:59.189692 run iperf3-srv_10.42.42.10(pid=13065): Launched 23:26:59.307642 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:26:59.519931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:59.835960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13066): Launched 23:27:00.109261 run iperf3-srv_10.42.42.10(pid=13067): Launched 23:27:00.227334 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:27:00.440182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:00.756553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13068): Launched 23:27:01.096010 run iperf3-srv_10.42.42.10(pid=13069): Launched 23:27:01.221149 tst iperf3m4.py:8: start network... 23:27:01.437840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:01.954476 run create_hlr_db(pid=13070): Launched 23:27:02.098523 bus /gobi_6: Setting Powered False 23:27:03.157500 run create_hlr_db(pid=13070): Terminated: ok {rc=0} 23:27:03.570513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13072): Launched 23:27:03.865319 run osmo-hlr_10.42.42.2(pid=13073): Launched 23:27:03.978511 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:04.499890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13075): Launched 23:27:04.794630 run osmo-stp_10.42.42.5(pid=13076): Launched 23:27:04.906221 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:05.414180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13078): Launched 23:27:05.527938 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:05.777670 run patchelf(pid=13079): Launched 23:27:05.942004 run osmo-stp_10.42.42.5(pid=13076): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13076)] 23:27:06.067903 run osmo-stp_10.42.42.5(pid=13076): stdout: | (launched: 2022-12-13_23:27:04.740805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:06.194887 run osmo-stp_10.42.42.5(pid=13076): stderr: | [0;m[38;5;43m20221213232704911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232704912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232704912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232704912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232704913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232704913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232704913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:06.321993 run osmo-stp_10.42.42.5(pid=13076): stdout: | (launched: 2022-12-13_23:27:04.740805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:06.443134 run osmo-stp_10.42.42.5(pid=13076): stderr: | [0;m[38;5;43m20221213232704911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232704912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232704912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232704912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232704913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232704913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232704913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:06.587122 run patchelf(pid=13079): Terminating (SIGINT) 23:27:06.753420 run patchelf(pid=13079): Terminated: ok {rc=0} 23:27:06.872795 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13076): Process ended prematurely: osmo-stp_10.42.42.5(pid=13076) [trial-2396↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13076)] [trial-2396↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 23:27:06.882210 tst iperf3m4.py:8: Test FAILED (10.6 sec) 23:27:06.909161 run osmo-hlr_10.42.42.2(pid=13073): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13073)] 23:27:06.957201 run osmo-hlr_10.42.42.2(pid=13073): stdout: | (launched: 2022-12-13_23:27:03.811500) 23:27:07.006389 run osmo-hlr_10.42.42.2(pid=13073): stderr: | [0;m[1;31m20221213232703986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232703986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232703986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232703986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232703986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232703986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232703999 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232704008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232704008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232704008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:07.056012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13062): Terminating (SIGTERM) 23:27:07.095613 run iperf3-srv_10.42.42.10(pid=13063): Terminating (SIGTERM) 23:27:07.134993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13064): Terminating (SIGTERM) 23:27:07.174293 run iperf3-srv_10.42.42.10(pid=13065): Terminating (SIGTERM) 23:27:07.213533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13066): Terminating (SIGTERM) 23:27:07.252927 run iperf3-srv_10.42.42.10(pid=13067): Terminating (SIGTERM) 23:27:07.292169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13068): Terminating (SIGTERM) 23:27:07.331532 run iperf3-srv_10.42.42.10(pid=13069): Terminating (SIGTERM) 23:27:07.370766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13072): Terminating (SIGTERM) 23:27:07.410164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13075): Terminating (SIGTERM) 23:27:07.449519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13078): Terminating (SIGTERM) 23:27:07.489161 --- ParallelTerminationStrategy: PID 13062 died... 23:27:07.508153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13062): Terminated: ok {rc=0} 23:27:07.552321 --- ParallelTerminationStrategy: PID 13063 died... 23:27:07.570967 run iperf3-srv_10.42.42.10(pid=13063): Terminated {rc=256} 23:27:07.614626 --- ParallelTerminationStrategy: PID 13064 died... 23:27:07.633090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13064): Terminated: ok {rc=0} 23:27:07.676544 --- ParallelTerminationStrategy: PID 13065 died... 23:27:07.694949 run iperf3-srv_10.42.42.10(pid=13065): Terminated {rc=256} 23:27:07.738218 --- ParallelTerminationStrategy: PID 13066 died... 23:27:07.756679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13066): Terminated: ok {rc=0} 23:27:07.800083 --- ParallelTerminationStrategy: PID 13067 died... 23:27:07.818527 run iperf3-srv_10.42.42.10(pid=13067): Terminated {rc=256} 23:27:07.861720 --- ParallelTerminationStrategy: PID 13068 died... 23:27:07.880088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13068): Terminated: ok {rc=0} 23:27:07.923480 --- ParallelTerminationStrategy: PID 13069 died... 23:27:07.941960 run iperf3-srv_10.42.42.10(pid=13069): Terminated {rc=256} 23:27:07.985590 --- ParallelTerminationStrategy: PID 13072 died... 23:27:08.004024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13072): Terminated: ok {rc=0} 23:27:08.047599 --- ParallelTerminationStrategy: PID 13075 died... 23:27:08.066033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13075): Terminated: ok {rc=0} 23:27:08.110620 --- ParallelTerminationStrategy: PID 13078 died... 23:27:08.129378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13078): Terminated: ok {rc=0} 23:27:08.215446 bus /gobi_4: Setting Powered False 23:27:09.315614 bus /gobi_4: Setting Powered False 23:27:10.432256 bus /gobi_1: Setting Powered False 23:27:11.528738 bus /gobi_1: Setting Powered False 23:27:12.646782 bus /gobi_0: Setting Powered False 23:27:13.746071 bus /gobi_0: Setting Powered False 23:27:14.859066 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 23:27:15.972890 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:15.985119 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:27:16.024713 tst ping.py: using LAC 36961 23:27:16.146364 tst ping.py: using RAC 241 23:27:16.269818 tst ping.py: using CellId 36961 23:27:16.433100 tst ping.py: using BVCI 36962 23:27:16.565328 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.576397 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.587872 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.598644 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.609940 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.621117 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.633078 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.644531 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:27:16.781337 tst ping.py:19: start network... 23:27:17.020430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:17.507497 run create_hlr_db(pid=13080): Launched 23:27:17.625662 bus /gobi_6: Setting Powered False 23:27:18.686910 run create_hlr_db(pid=13080): Terminated: ok {rc=0} 23:27:19.103258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13082): Launched 23:27:19.392400 run osmo-hlr_10.42.42.2(pid=13083): Launched 23:27:19.502018 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:20.015730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13085): Launched 23:27:20.306841 run osmo-stp_10.42.42.5(pid=13086): Launched 23:27:20.417265 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:20.916392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13088): Launched 23:27:21.026486 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:21.270726 run patchelf(pid=13089): Launched 23:27:21.431348 run osmo-stp_10.42.42.5(pid=13086): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13086)] 23:27:21.554724 run osmo-stp_10.42.42.5(pid=13086): stdout: | (launched: 2022-12-13_23:27:20.253951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:21.679355 run osmo-stp_10.42.42.5(pid=13086): stderr: | [0;m[38;5;43m20221213232720423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232720423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232720424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232720424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232720425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232720425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232720425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:21.804273 run osmo-stp_10.42.42.5(pid=13086): stdout: | (launched: 2022-12-13_23:27:20.253951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:21.923492 run osmo-stp_10.42.42.5(pid=13086): stderr: | [0;m[38;5;43m20221213232720423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232720423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232720424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232720424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232720425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232720425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232720425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:22.064897 run patchelf(pid=13089): Terminating (SIGINT) 23:27:22.228529 run patchelf(pid=13089): Terminated: ok {rc=0} 23:27:22.345685 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13086): Process ended prematurely: osmo-stp_10.42.42.5(pid=13086) [trial-2396↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13086)] [trial-2396↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 23:27:22.354374 tst ping.py:22: Test FAILED (6.4 sec) 23:27:22.380578 run osmo-hlr_10.42.42.2(pid=13083): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13083)] 23:27:22.429124 run osmo-hlr_10.42.42.2(pid=13083): stdout: | (launched: 2022-12-13_23:27:19.339393) 23:27:22.478414 run osmo-hlr_10.42.42.2(pid=13083): stderr: | [0;m[1;31m20221213232719514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232719514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232719514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232719514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232719514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232719514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232719527 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232719535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232719535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232719535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:22.527913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13082): Terminating (SIGTERM) 23:27:22.567609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13085): Terminating (SIGTERM) 23:27:22.607139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13088): Terminating (SIGTERM) 23:27:22.647042 --- ParallelTerminationStrategy: PID 13082 died... 23:27:22.666365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13082): Terminated: ok {rc=0} 23:27:22.710264 --- ParallelTerminationStrategy: PID 13085 died... 23:27:22.728880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13085): Terminated: ok {rc=0} 23:27:22.772464 --- ParallelTerminationStrategy: PID 13088 died... 23:27:22.790912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13088): Terminated: ok {rc=0} 23:27:22.873764 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:27:23.959742 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:23.971864 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:27:24.012857 tst ping_idle_ping.py: using LAC 36962 23:27:24.135874 tst ping_idle_ping.py: using RAC 242 23:27:24.252195 tst ping_idle_ping.py: using CellId 36962 23:27:24.368558 tst ping_idle_ping.py: using BVCI 36963 23:27:24.474235 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.485055 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.495796 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.506515 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.517067 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.527442 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.538133 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.549179 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:27:24.666736 tst ping_idle_ping.py:24: start network... 23:27:24.862895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:25.315662 run create_hlr_db(pid=13090): Launched 23:27:25.434543 bus /gobi_6: Setting Powered False 23:27:26.492829 run create_hlr_db(pid=13090): Terminated: ok {rc=0} 23:27:26.900542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13092): Launched 23:27:27.192222 run osmo-hlr_10.42.42.2(pid=13093): Launched 23:27:27.303057 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:27.803295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13095): Launched 23:27:28.093703 run osmo-stp_10.42.42.5(pid=13096): Launched 23:27:28.204898 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:28.707998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13098): Launched 23:27:28.819301 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:29.065031 run patchelf(pid=13099): Launched 23:27:29.226936 run osmo-stp_10.42.42.5(pid=13096): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13096)] 23:27:29.351049 run osmo-stp_10.42.42.5(pid=13096): stdout: | (launched: 2022-12-13_23:27:28.040648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:29.476658 run osmo-stp_10.42.42.5(pid=13096): stderr: | [0;m[38;5;43m20221213232728208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232728208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232728208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232728209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232728209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232728209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232728210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:29.602413 run osmo-stp_10.42.42.5(pid=13096): stdout: | (launched: 2022-12-13_23:27:28.040648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:29.722741 run osmo-stp_10.42.42.5(pid=13096): stderr: | [0;m[38;5;43m20221213232728208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232728208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232728208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232728209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232728209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232728209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232728210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:29.865191 run patchelf(pid=13099): Terminating (SIGINT) 23:27:30.028839 run patchelf(pid=13099): Terminated: ok {rc=0} 23:27:30.146401 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13096): Process ended prematurely: osmo-stp_10.42.42.5(pid=13096) [trial-2396↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13096)] [trial-2396↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 23:27:30.155680 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 23:27:30.182363 run osmo-hlr_10.42.42.2(pid=13093): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13093)] 23:27:30.230715 run osmo-hlr_10.42.42.2(pid=13093): stdout: | (launched: 2022-12-13_23:27:27.138742) 23:27:30.280253 run osmo-hlr_10.42.42.2(pid=13093): stderr: | [0;m[1;31m20221213232727311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232727311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232727311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232727311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232727311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232727311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232727355 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232727366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232727367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232727367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:30.330307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13092): Terminating (SIGTERM) 23:27:30.370441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13095): Terminating (SIGTERM) 23:27:30.410459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13098): Terminating (SIGTERM) 23:27:30.450899 --- ParallelTerminationStrategy: PID 13092 died... 23:27:30.470454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13092): Terminated: ok {rc=0} 23:27:30.514834 --- ParallelTerminationStrategy: PID 13095 died... 23:27:30.533787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13095): Terminated: ok {rc=0} 23:27:30.577892 --- ParallelTerminationStrategy: PID 13098 died... 23:27:30.596737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13098): Terminated: ok {rc=0} 23:27:30.680149 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:27:31.992212 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:27:32.001131 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:27:32.021943 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:27:32.062419 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:27:32.150821 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:27:32.172910 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:27:32.215347 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:27:32.805914 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:27:32.857514 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:32.868620 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:27:32.925983 tst cs_paging_gprs_active.py: using LAC 36963 23:27:33.050390 tst cs_paging_gprs_active.py: using RAC 243 23:27:33.174193 tst cs_paging_gprs_active.py: using CellId 36963 23:27:33.299768 tst cs_paging_gprs_active.py: using BVCI 36964 23:27:33.416337 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.427664 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.438683 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.449666 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.460765 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.472040 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.483420 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.494640 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.506054 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:33.623117 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:33.741050 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:27:33.954578 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:34.272008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13103): Launched 23:27:34.546884 run iperf3-srv_10.42.42.10(pid=13104): Launched 23:27:34.666055 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:27:34.880890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:35.198109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13105): Launched 23:27:35.472627 run iperf3-srv_10.42.42.10(pid=13106): Launched 23:27:35.591189 tst cs_paging_gprs_active.py:38: start network... 23:27:35.806076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:36.296737 run create_hlr_db(pid=13107): Launched 23:27:36.417289 bus /gobi_6: Setting Powered False 23:27:37.480390 run create_hlr_db(pid=13107): Terminated: ok {rc=0} 23:27:37.903813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13109): Launched 23:27:38.198615 run osmo-hlr_10.42.42.2(pid=13110): Launched 23:27:38.311758 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:38.839012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13112): Launched 23:27:39.136463 run osmo-stp_10.42.42.5(pid=13113): Launched 23:27:39.249161 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:39.760905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13115): Launched 23:27:39.874943 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:40.125605 run patchelf(pid=13116): Launched 23:27:40.291111 run osmo-stp_10.42.42.5(pid=13113): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13113)] 23:27:40.416925 run osmo-stp_10.42.42.5(pid=13113): stdout: | (launched: 2022-12-13_23:27:39.082490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:40.544734 run osmo-stp_10.42.42.5(pid=13113): stderr: | [0;m[38;5;43m20221213232739250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232739250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232739251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232739251 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232739253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232739253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232739253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:40.672392 run osmo-stp_10.42.42.5(pid=13113): stdout: | (launched: 2022-12-13_23:27:39.082490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:40.794060 run osmo-stp_10.42.42.5(pid=13113): stderr: | [0;m[38;5;43m20221213232739250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232739250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232739251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232739251 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232739253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232739253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232739253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:40.938300 run patchelf(pid=13116): Terminating (SIGINT) 23:27:41.104935 run patchelf(pid=13116): Terminated: ok {rc=0} 23:27:41.224912 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13113): Process ended prematurely: osmo-stp_10.42.42.5(pid=13113) [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13113)] [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:27:41.234154 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 23:27:41.260701 run osmo-hlr_10.42.42.2(pid=13110): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13110)] 23:27:41.307926 run osmo-hlr_10.42.42.2(pid=13110): stdout: | (launched: 2022-12-13_23:27:38.145481) 23:27:41.356903 run osmo-hlr_10.42.42.2(pid=13110): stderr: | [0;m[1;31m20221213232738321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232738321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232738321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232738321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232738322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232738322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232738334 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232738343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232738343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232738343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:41.406313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13103): Terminating (SIGTERM) 23:27:41.445537 run iperf3-srv_10.42.42.10(pid=13104): Terminating (SIGTERM) 23:27:41.484502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13105): Terminating (SIGTERM) 23:27:41.523466 run iperf3-srv_10.42.42.10(pid=13106): Terminating (SIGTERM) 23:27:41.562373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13109): Terminating (SIGTERM) 23:27:41.601730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13112): Terminating (SIGTERM) 23:27:41.640675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13115): Terminating (SIGTERM) 23:27:41.679804 --- ParallelTerminationStrategy: PID 13103 died... 23:27:41.698575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13103): Terminated: ok {rc=0} 23:27:41.741764 --- ParallelTerminationStrategy: PID 13104 died... 23:27:41.759816 run iperf3-srv_10.42.42.10(pid=13104): Terminated {rc=256} 23:27:41.802674 --- ParallelTerminationStrategy: PID 13105 died... 23:27:41.820816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13105): Terminated: ok {rc=0} 23:27:41.863712 --- ParallelTerminationStrategy: PID 13106 died... 23:27:41.881874 run iperf3-srv_10.42.42.10(pid=13106): Terminated {rc=256} 23:27:41.924695 --- ParallelTerminationStrategy: PID 13109 died... 23:27:41.943185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13109): Terminated: ok {rc=0} 23:27:41.986256 --- ParallelTerminationStrategy: PID 13112 died... 23:27:42.004329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13112): Terminated: ok {rc=0} 23:27:42.047157 --- ParallelTerminationStrategy: PID 13115 died... 23:27:42.065341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13115): Terminated: ok {rc=0} 23:27:42.147437 bus /gobi_0: Setting Powered False 23:27:43.244467 bus /gobi_0: Setting Powered False 23:27:44.358125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:27:45.504181 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:45.516123 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:27:45.576693 tst iperf3.py: using LAC 36964 23:27:45.702177 tst iperf3.py: using RAC 244 23:27:45.826913 tst iperf3.py: using CellId 36964 23:27:45.984915 tst iperf3.py: using BVCI 36965 23:27:46.135585 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.150282 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.164525 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.178305 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.192366 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.206092 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.220069 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.233965 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.248066 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:46.375837 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:27:46.655659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:46.989489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13118): Launched 23:27:47.271529 run iperf3-srv_10.42.42.10(pid=13119): Launched 23:27:47.390748 tst iperf3.py:8: start network... 23:27:47.589980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:48.046330 run create_hlr_db(pid=13120): Launched 23:27:48.166781 bus /gobi_6: Setting Powered False 23:27:49.225850 run create_hlr_db(pid=13120): Terminated: ok {rc=0} 23:27:49.658331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13122): Launched 23:27:49.975425 run osmo-hlr_10.42.42.2(pid=13123): Launched 23:27:50.096423 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:50.643632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13125): Launched 23:27:50.958374 run osmo-stp_10.42.42.5(pid=13126): Launched 23:27:51.078311 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:51.620643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13128): Launched 23:27:51.741726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:52.008753 run patchelf(pid=13129): Launched 23:27:52.183828 run osmo-stp_10.42.42.5(pid=13126): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13126)] 23:27:52.317899 run osmo-stp_10.42.42.5(pid=13126): stdout: | (launched: 2022-12-13_23:27:50.901780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:52.453765 run osmo-stp_10.42.42.5(pid=13126): stderr: | [0;m[38;5;43m20221213232751090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232751090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232751091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232751091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232751091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232751092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232751092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:52.589754 run osmo-stp_10.42.42.5(pid=13126): stdout: | (launched: 2022-12-13_23:27:50.901780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:52.719469 run osmo-stp_10.42.42.5(pid=13126): stderr: | [0;m[38;5;43m20221213232751090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232751090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232751091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232751091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232751091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232751092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232751092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:52.873594 run patchelf(pid=13129): Terminating (SIGINT) 23:27:53.050959 run patchelf(pid=13129): Terminated: ok {rc=0} 23:27:53.178669 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13126): Process ended prematurely: osmo-stp_10.42.42.5(pid=13126) [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13126)] [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 23:27:53.188525 tst iperf3.py:8: Test FAILED (7.7 sec) 23:27:53.216421 run osmo-hlr_10.42.42.2(pid=13123): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13123)] 23:27:53.267261 run osmo-hlr_10.42.42.2(pid=13123): stdout: | (launched: 2022-12-13_23:27:49.918735) 23:27:53.318804 run osmo-hlr_10.42.42.2(pid=13123): stderr: | [0;m[1;31m20221213232750116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232750116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232750116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232750116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232750116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232750116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232750129 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232750137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232750137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232750137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:53.371349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13118): Terminating (SIGTERM) 23:27:53.412637 run iperf3-srv_10.42.42.10(pid=13119): Terminating (SIGTERM) 23:27:53.454150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13122): Terminating (SIGTERM) 23:27:53.495676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13125): Terminating (SIGTERM) 23:27:53.537628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13128): Terminating (SIGTERM) 23:27:53.579338 --- ParallelTerminationStrategy: PID 13118 died... 23:27:53.599448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13118): Terminated: ok {rc=0} 23:27:53.645944 --- ParallelTerminationStrategy: PID 13119 died... 23:27:53.665706 run iperf3-srv_10.42.42.10(pid=13119): Terminated {rc=256} 23:27:53.711603 --- ParallelTerminationStrategy: PID 13122 died... 23:27:53.731356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13122): Terminated: ok {rc=0} 23:27:53.777031 --- ParallelTerminationStrategy: PID 13125 died... 23:27:53.796437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13125): Terminated: ok {rc=0} 23:27:53.842546 --- ParallelTerminationStrategy: PID 13128 died... 23:27:53.862346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13128): Terminated: ok {rc=0} 23:27:53.950340 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:27:55.098868 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.110609 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:27:55.169443 tst iperf3m4.py: using LAC 36965 23:27:55.288154 tst iperf3m4.py: using RAC 245 23:27:55.404847 tst iperf3m4.py: using CellId 36965 23:27:55.520070 tst iperf3m4.py: using BVCI 36966 23:27:55.626862 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.637930 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.648373 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.658790 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.669205 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.679592 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.690289 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.700703 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.711327 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:55.826277 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:55.948924 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:56.068618 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:56.185372 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:27:56.383780 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:56.678855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13130): Launched 23:27:56.934946 run iperf3-srv_10.42.42.10(pid=13131): Launched 23:27:57.045243 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:27:57.243087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:57.538132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13132): Launched 23:27:57.794577 run iperf3-srv_10.42.42.10(pid=13133): Launched 23:27:57.905254 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:27:58.103926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:58.401072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13134): Launched 23:27:58.658339 run iperf3-srv_10.42.42.10(pid=13135): Launched 23:27:58.769242 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:27:58.967311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:59.263476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13136): Launched 23:27:59.520809 run iperf3-srv_10.42.42.10(pid=13137): Launched 23:27:59.631386 tst iperf3m4.py:8: start network... 23:27:59.829913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:00.288206 run create_hlr_db(pid=13138): Launched 23:28:00.409955 bus /gobi_6: Setting Powered False 23:28:01.479624 run create_hlr_db(pid=13138): Terminated: ok {rc=0} 23:28:01.959238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13140): Launched 23:28:02.278896 run osmo-hlr_10.42.42.2(pid=13141): Launched 23:28:02.402111 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:02.950776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13143): Launched 23:28:03.267871 run osmo-stp_10.42.42.5(pid=13144): Launched 23:28:03.389351 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:03.937799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13146): Launched 23:28:04.059636 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:04.328562 run patchelf(pid=13147): Launched 23:28:04.506334 run osmo-stp_10.42.42.5(pid=13144): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13144)] 23:28:04.640891 run osmo-stp_10.42.42.5(pid=13144): stdout: | (launched: 2022-12-13_23:28:03.210471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:04.778138 run osmo-stp_10.42.42.5(pid=13144): stderr: | [0;m[38;5;43m20221213232803402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232803402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232803402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232803402 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232803403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232803403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232803403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:04.914993 run osmo-stp_10.42.42.5(pid=13144): stdout: | (launched: 2022-12-13_23:28:03.210471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:05.045220 run osmo-stp_10.42.42.5(pid=13144): stderr: | [0;m[38;5;43m20221213232803402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232803402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232803402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232803402 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232803403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232803403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232803403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:05.199878 run patchelf(pid=13147): Terminating (SIGINT) 23:28:05.378213 run patchelf(pid=13147): Terminated: ok {rc=0} 23:28:05.506888 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13144): Process ended prematurely: osmo-stp_10.42.42.5(pid=13144) [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13144)] [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:28:05.516820 tst iperf3m4.py:8: Test FAILED (10.5 sec) 23:28:05.545344 run osmo-hlr_10.42.42.2(pid=13141): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13141)] 23:28:05.595759 run osmo-hlr_10.42.42.2(pid=13141): stdout: | (launched: 2022-12-13_23:28:02.216810) 23:28:05.647361 run osmo-hlr_10.42.42.2(pid=13141): stderr: | [0;m[1;31m20221213232802416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232802416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232802416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232802416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232802416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232802416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232802429 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232802437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232802438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232802438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:05.699267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13130): Terminating (SIGTERM) 23:28:05.741435 run iperf3-srv_10.42.42.10(pid=13131): Terminating (SIGTERM) 23:28:05.783126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13132): Terminating (SIGTERM) 23:28:05.825396 run iperf3-srv_10.42.42.10(pid=13133): Terminating (SIGTERM) 23:28:05.867158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13134): Terminating (SIGTERM) 23:28:05.909812 run iperf3-srv_10.42.42.10(pid=13135): Terminating (SIGTERM) 23:28:05.951847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13136): Terminating (SIGTERM) 23:28:05.994267 run iperf3-srv_10.42.42.10(pid=13137): Terminating (SIGTERM) 23:28:06.036171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13140): Terminating (SIGTERM) 23:28:06.078197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13143): Terminating (SIGTERM) 23:28:06.119995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13146): Terminating (SIGTERM) 23:28:06.161922 --- ParallelTerminationStrategy: PID 13130 died... 23:28:06.182145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13130): Terminated: ok {rc=0} 23:28:06.228655 --- ParallelTerminationStrategy: PID 13131 died... 23:28:06.248428 run iperf3-srv_10.42.42.10(pid=13131): Terminated {rc=256} 23:28:06.294678 --- ParallelTerminationStrategy: PID 13132 died... 23:28:06.314576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13132): Terminated: ok {rc=0} 23:28:06.360794 --- ParallelTerminationStrategy: PID 13133 died... 23:28:06.381052 run iperf3-srv_10.42.42.10(pid=13133): Terminated {rc=256} 23:28:06.427165 --- ParallelTerminationStrategy: PID 13134 died... 23:28:06.447053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13134): Terminated: ok {rc=0} 23:28:06.493431 --- ParallelTerminationStrategy: PID 13135 died... 23:28:06.513096 run iperf3-srv_10.42.42.10(pid=13135): Terminated {rc=256} 23:28:06.559041 --- ParallelTerminationStrategy: PID 13136 died... 23:28:06.578776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13136): Terminated: ok {rc=0} 23:28:06.624821 --- ParallelTerminationStrategy: PID 13137 died... 23:28:06.645063 run iperf3-srv_10.42.42.10(pid=13137): Terminated {rc=256} 23:28:06.691222 --- ParallelTerminationStrategy: PID 13140 died... 23:28:06.710982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13140): Terminated: ok {rc=0} 23:28:06.757440 --- ParallelTerminationStrategy: PID 13143 died... 23:28:06.777363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13143): Terminated: ok {rc=0} 23:28:06.823806 --- ParallelTerminationStrategy: PID 13146 died... 23:28:06.843428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13146): Terminated: ok {rc=0} 23:28:06.931198 bus /gobi_4: Setting Powered False 23:28:08.029416 bus /gobi_4: Setting Powered False 23:28:09.144392 bus /gobi_1: Setting Powered False 23:28:10.241769 bus /gobi_1: Setting Powered False 23:28:11.359963 bus /gobi_0: Setting Powered False 23:28:12.460182 bus /gobi_0: Setting Powered False 23:28:13.575659 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:28:14.677023 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:14.688682 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:28:14.747465 tst ping.py: using LAC 36966 23:28:14.862834 tst ping.py: using RAC 246 23:28:14.980220 tst ping.py: using CellId 36966 23:28:15.093622 tst ping.py: using BVCI 36967 23:28:15.198838 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.209875 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.220518 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.231241 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.241914 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.252555 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.263257 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.274335 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:28:15.391585 tst ping.py:19: start network... 23:28:15.602475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:16.123652 run create_hlr_db(pid=13148): Launched 23:28:16.277599 bus /gobi_6: Setting Powered False 23:28:17.337163 run create_hlr_db(pid=13148): Terminated: ok {rc=0} 23:28:17.747739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13150): Launched 23:28:18.037485 run osmo-hlr_10.42.42.2(pid=13151): Launched 23:28:18.147257 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:18.663193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13153): Launched 23:28:18.952082 run osmo-stp_10.42.42.5(pid=13154): Launched 23:28:19.061792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:19.563747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13156): Launched 23:28:19.675164 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:19.921534 run patchelf(pid=13157): Launched 23:28:20.083366 run osmo-stp_10.42.42.5(pid=13154): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13154)] 23:28:20.207023 run osmo-stp_10.42.42.5(pid=13154): stdout: | (launched: 2022-12-13_23:28:18.898958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:20.332550 run osmo-stp_10.42.42.5(pid=13154): stderr: | [0;m[38;5;43m20221213232819067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232819067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232819067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232819068 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232819068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232819068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232819068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:20.458027 run osmo-stp_10.42.42.5(pid=13154): stdout: | (launched: 2022-12-13_23:28:18.898958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:20.578771 run osmo-stp_10.42.42.5(pid=13154): stderr: | [0;m[38;5;43m20221213232819067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232819067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232819067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232819068 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232819068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232819068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232819068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:20.721064 run patchelf(pid=13157): Terminating (SIGINT) 23:28:20.885321 run patchelf(pid=13157): Terminated: ok {rc=0} 23:28:21.003034 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13154): Process ended prematurely: osmo-stp_10.42.42.5(pid=13154) [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13154)] [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 23:28:21.011827 tst ping.py:22: Test FAILED (6.3 sec) 23:28:21.038272 run osmo-hlr_10.42.42.2(pid=13151): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13151)] 23:28:21.085705 run osmo-hlr_10.42.42.2(pid=13151): stdout: | (launched: 2022-12-13_23:28:17.984351) 23:28:21.134678 run osmo-hlr_10.42.42.2(pid=13151): stderr: | [0;m[1;31m20221213232818160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232818160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232818161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232818161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232818161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232818161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232818173 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232818181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232818182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232818182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:21.183986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13150): Terminating (SIGTERM) 23:28:21.223536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13153): Terminating (SIGTERM) 23:28:21.263350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13156): Terminating (SIGTERM) 23:28:21.303276 --- ParallelTerminationStrategy: PID 13150 died... 23:28:21.322470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13150): Terminated: ok {rc=0} 23:28:21.366345 --- ParallelTerminationStrategy: PID 13153 died... 23:28:21.384906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13153): Terminated: ok {rc=0} 23:28:21.428492 --- ParallelTerminationStrategy: PID 13156 died... 23:28:21.447145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13156): Terminated: ok {rc=0} 23:28:21.531255 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:28:22.617357 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:22.629782 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:28:22.690685 tst ping_idle_ping.py: using LAC 36967 23:28:22.814546 tst ping_idle_ping.py: using RAC 247 23:28:22.938261 tst ping_idle_ping.py: using CellId 36967 23:28:23.060684 tst ping_idle_ping.py: using BVCI 36968 23:28:23.174146 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.185421 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.196450 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.207619 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.218906 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.230374 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.242003 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.253465 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:28:23.370470 tst ping_idle_ping.py:24: start network... 23:28:23.581033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:24.066313 run create_hlr_db(pid=13158): Launched 23:28:24.185159 bus /gobi_6: Setting Powered False 23:28:25.246887 run create_hlr_db(pid=13158): Terminated: ok {rc=0} 23:28:25.667362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13160): Launched 23:28:25.958424 run osmo-hlr_10.42.42.2(pid=13161): Launched 23:28:26.069025 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:26.585620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13163): Launched 23:28:26.877600 run osmo-stp_10.42.42.5(pid=13164): Launched 23:28:26.989715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:27.514084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13166): Launched 23:28:27.625506 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:27.872198 run patchelf(pid=13167): Launched 23:28:28.034696 run osmo-stp_10.42.42.5(pid=13164): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13164)] 23:28:28.159022 run osmo-stp_10.42.42.5(pid=13164): stdout: | (launched: 2022-12-13_23:28:26.824405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:28.284533 run osmo-stp_10.42.42.5(pid=13164): stderr: | [0;m[38;5;43m20221213232826993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232826993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232826993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232826993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232826994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232826994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232826994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:28.410667 run osmo-stp_10.42.42.5(pid=13164): stdout: | (launched: 2022-12-13_23:28:26.824405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:28.530680 run osmo-stp_10.42.42.5(pid=13164): stderr: | [0;m[38;5;43m20221213232826993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232826993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232826993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232826993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232826994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232826994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232826994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:28.673824 run patchelf(pid=13167): Terminating (SIGINT) 23:28:28.837930 run patchelf(pid=13167): Terminated: ok {rc=0} 23:28:28.955919 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13164): Process ended prematurely: osmo-stp_10.42.42.5(pid=13164) [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13164)] [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:28:28.964758 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 23:28:28.991639 run osmo-hlr_10.42.42.2(pid=13161): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13161)] 23:28:29.039310 run osmo-hlr_10.42.42.2(pid=13161): stdout: | (launched: 2022-12-13_23:28:25.905533) 23:28:29.088587 run osmo-hlr_10.42.42.2(pid=13161): stderr: | [0;m[1;31m20221213232826078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232826078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232826078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232826078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232826078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232826078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232826090 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232826099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232826099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232826099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:29.138543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13160): Terminating (SIGTERM) 23:28:29.178054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13163): Terminating (SIGTERM) 23:28:29.217661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13166): Terminating (SIGTERM) 23:28:29.257707 --- ParallelTerminationStrategy: PID 13160 died... 23:28:29.276875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13160): Terminated: ok {rc=0} 23:28:29.320863 --- ParallelTerminationStrategy: PID 13163 died... 23:28:29.339562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13163): Terminated: ok {rc=0} 23:28:29.383233 --- ParallelTerminationStrategy: PID 13166 died... 23:28:29.401977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13166): Terminated: ok {rc=0} 23:28:29.487251 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:28:30.778632 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:28:30.784327 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:28:30.804265 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:28:30.848069 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:28:30.948497 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:28:30.973078 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:28:31.016721 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:28:31.637606 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:28:31.714021 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:31.725374 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:28:31.784506 tst cs_paging_gprs_active.py: using LAC 36968 23:28:31.902164 tst cs_paging_gprs_active.py: using RAC 248 23:28:32.067441 tst cs_paging_gprs_active.py: using CellId 36968 23:28:32.210545 tst cs_paging_gprs_active.py: using BVCI 36969 23:28:32.330531 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:32.342825 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:32.354999 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:32.366918 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:32.379897 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:32.391919 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:32.404178 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:32.416093 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:32.428202 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:32.545589 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:32.659272 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:28:32.859936 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:33.158076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13171): Launched 23:28:33.415249 run iperf3-srv_10.42.42.10(pid=13172): Launched 23:28:33.525917 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:28:33.724324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:34.021095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13173): Launched 23:28:34.277922 run iperf3-srv_10.42.42.10(pid=13174): Launched 23:28:34.388135 tst cs_paging_gprs_active.py:38: start network... 23:28:34.586719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:35.044389 run create_hlr_db(pid=13175): Launched 23:28:35.166222 bus /gobi_6: Setting Powered False 23:28:36.224332 run create_hlr_db(pid=13175): Terminated: ok {rc=0} 23:28:36.656226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13177): Launched 23:28:36.973389 run osmo-hlr_10.42.42.2(pid=13178): Launched 23:28:37.094075 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:37.638738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13180): Launched 23:28:37.955812 run osmo-stp_10.42.42.5(pid=13181): Launched 23:28:38.076253 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:38.620849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13183): Launched 23:28:38.743061 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:39.011440 run patchelf(pid=13184): Launched 23:28:39.188031 run osmo-stp_10.42.42.5(pid=13181): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13181)] 23:28:39.323312 run osmo-stp_10.42.42.5(pid=13181): stdout: | (launched: 2022-12-13_23:28:37.898906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:39.460185 run osmo-stp_10.42.42.5(pid=13181): stderr: | [0;m[38;5;43m20221213232838090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232838090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232838091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232838091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232838091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232838091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232838092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:39.597189 run osmo-stp_10.42.42.5(pid=13181): stdout: | (launched: 2022-12-13_23:28:37.898906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:39.727614 run osmo-stp_10.42.42.5(pid=13181): stderr: | [0;m[38;5;43m20221213232838090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232838090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232838091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232838091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232838091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232838091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232838092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:39.883017 run patchelf(pid=13184): Terminating (SIGINT) 23:28:40.061760 run patchelf(pid=13184): Terminated: ok {rc=0} 23:28:40.190442 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13181): Process ended prematurely: osmo-stp_10.42.42.5(pid=13181) [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13181)] [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:28:40.200508 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:28:40.228545 run osmo-hlr_10.42.42.2(pid=13178): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13178)] 23:28:40.279416 run osmo-hlr_10.42.42.2(pid=13178): stdout: | (launched: 2022-12-13_23:28:36.915894) 23:28:40.331316 run osmo-hlr_10.42.42.2(pid=13178): stderr: | [0;m[1;31m20221213232837113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232837113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232837113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232837113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232837113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232837113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232837129 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232837139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232837139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232837139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:40.383452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13171): Terminating (SIGTERM) 23:28:40.424933 run iperf3-srv_10.42.42.10(pid=13172): Terminating (SIGTERM) 23:28:40.467169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13173): Terminating (SIGTERM) 23:28:40.509296 run iperf3-srv_10.42.42.10(pid=13174): Terminating (SIGTERM) 23:28:40.551527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13177): Terminating (SIGTERM) 23:28:40.593820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13180): Terminating (SIGTERM) 23:28:40.635781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13183): Terminating (SIGTERM) 23:28:40.677315 --- ParallelTerminationStrategy: PID 13171 died... 23:28:40.697457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13171): Terminated: ok {rc=0} 23:28:40.744000 --- ParallelTerminationStrategy: PID 13172 died... 23:28:40.763704 run iperf3-srv_10.42.42.10(pid=13172): Terminated {rc=256} 23:28:40.809262 --- ParallelTerminationStrategy: PID 13173 died... 23:28:40.828760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13173): Terminated: ok {rc=0} 23:28:40.874551 --- ParallelTerminationStrategy: PID 13174 died... 23:28:40.894204 run iperf3-srv_10.42.42.10(pid=13174): Terminated {rc=256} 23:28:40.939698 --- ParallelTerminationStrategy: PID 13177 died... 23:28:40.959172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13177): Terminated: ok {rc=0} 23:28:41.004910 --- ParallelTerminationStrategy: PID 13180 died... 23:28:41.024825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13180): Terminated: ok {rc=0} 23:28:41.070744 --- ParallelTerminationStrategy: PID 13183 died... 23:28:41.090322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13183): Terminated: ok {rc=0} 23:28:41.178395 bus /gobi_0: Setting Powered False 23:28:42.276466 bus /gobi_0: Setting Powered False 23:28:43.393285 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:28:44.538394 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:44.549910 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:28:44.609371 tst iperf3.py: using LAC 36969 23:28:44.727273 tst iperf3.py: using RAC 249 23:28:44.845573 tst iperf3.py: using CellId 36969 23:28:44.967119 tst iperf3.py: using BVCI 36970 23:28:45.075739 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.086635 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.097323 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.107823 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.118475 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.128917 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.140147 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.150803 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.161620 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:45.275765 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:28:45.475787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:45.771149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13185): Launched 23:28:46.085882 run iperf3-srv_10.42.42.10(pid=13186): Launched 23:28:46.217907 tst iperf3.py:8: start network... 23:28:46.424232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:46.900818 run create_hlr_db(pid=13187): Launched 23:28:47.045396 bus /gobi_6: Setting Powered False 23:28:48.104775 run create_hlr_db(pid=13187): Terminated: ok {rc=0} 23:28:48.537663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13189): Launched 23:28:48.854037 run osmo-hlr_10.42.42.2(pid=13190): Launched 23:28:48.974727 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:49.522723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13192): Launched 23:28:49.837808 run osmo-stp_10.42.42.5(pid=13193): Launched 23:28:49.958022 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:50.503841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13195): Launched 23:28:50.621691 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:50.874829 run patchelf(pid=13196): Launched 23:28:51.039193 run osmo-stp_10.42.42.5(pid=13193): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13193)] 23:28:51.164773 run osmo-stp_10.42.42.5(pid=13193): stdout: | (launched: 2022-12-13_23:28:49.780611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:51.292461 run osmo-stp_10.42.42.5(pid=13193): stderr: | [0;m[38;5;43m20221213232849971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232849971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232849972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232849972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232849972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232849973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232849973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:51.420508 run osmo-stp_10.42.42.5(pid=13193): stdout: | (launched: 2022-12-13_23:28:49.780611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:51.542409 run osmo-stp_10.42.42.5(pid=13193): stderr: | [0;m[38;5;43m20221213232849971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232849971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232849972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232849972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232849972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232849973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232849973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:51.686757 run patchelf(pid=13196): Terminating (SIGINT) 23:28:51.853628 run patchelf(pid=13196): Terminated: ok {rc=0} 23:28:51.973884 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13193): Process ended prematurely: osmo-stp_10.42.42.5(pid=13193) [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13193)] [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 23:28:51.983209 tst iperf3.py:8: Test FAILED (7.5 sec) 23:28:52.009828 run osmo-hlr_10.42.42.2(pid=13190): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13190)] 23:28:52.057108 run osmo-hlr_10.42.42.2(pid=13190): stdout: | (launched: 2022-12-13_23:28:48.796905) 23:28:52.106078 run osmo-hlr_10.42.42.2(pid=13190): stderr: | [0;m[1;31m20221213232848996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232848996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232848996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232848996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232848996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232848996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232849008 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232849017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232849017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232849017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:52.155573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13185): Terminating (SIGTERM) 23:28:52.195178 run iperf3-srv_10.42.42.10(pid=13186): Terminating (SIGTERM) 23:28:52.234729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13189): Terminating (SIGTERM) 23:28:52.274294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13192): Terminating (SIGTERM) 23:28:52.313833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13195): Terminating (SIGTERM) 23:28:52.353635 --- ParallelTerminationStrategy: PID 13185 died... 23:28:52.372475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13185): Terminated: ok {rc=0} 23:28:52.416326 --- ParallelTerminationStrategy: PID 13186 died... 23:28:52.434965 run iperf3-srv_10.42.42.10(pid=13186): Terminated {rc=256} 23:28:52.478407 --- ParallelTerminationStrategy: PID 13189 died... 23:28:52.497003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13189): Terminated: ok {rc=0} 23:28:52.540301 --- ParallelTerminationStrategy: PID 13192 died... 23:28:52.558831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13192): Terminated: ok {rc=0} 23:28:52.602209 --- ParallelTerminationStrategy: PID 13195 died... 23:28:52.620838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13195): Terminated: ok {rc=0} 23:28:52.706715 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:28:53.854323 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:53.865731 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:28:53.922773 tst iperf3m4.py: using LAC 36970 23:28:54.039901 tst iperf3m4.py: using RAC 250 23:28:54.159171 tst iperf3m4.py: using CellId 36970 23:28:54.276272 tst iperf3m4.py: using BVCI 36971 23:28:54.383883 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:54.394721 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:54.405279 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:54.415766 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:54.426261 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:54.436798 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:54.447504 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:54.457990 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:54.468579 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:54.584105 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:54.704723 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:54.824507 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:54.941128 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:28:55.140818 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:55.438327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13197): Launched 23:28:55.696367 run iperf3-srv_10.42.42.10(pid=13198): Launched 23:28:55.807084 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:28:56.006150 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:56.303210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13199): Launched 23:28:56.560398 run iperf3-srv_10.42.42.10(pid=13200): Launched 23:28:56.671190 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:28:56.870820 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:57.168088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13201): Launched 23:28:57.425212 run iperf3-srv_10.42.42.10(pid=13202): Launched 23:28:57.536239 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:28:57.735107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:58.032223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13203): Launched 23:28:58.290010 run iperf3-srv_10.42.42.10(pid=13204): Launched 23:28:58.400650 tst iperf3m4.py:8: start network... 23:28:58.599116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:59.058543 run create_hlr_db(pid=13205): Launched 23:28:59.179745 bus /gobi_6: Setting Powered False 23:29:00.239099 run create_hlr_db(pid=13205): Terminated: ok {rc=0} 23:29:00.671801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13207): Launched 23:29:01.012042 run osmo-hlr_10.42.42.2(pid=13208): Launched 23:29:01.281560 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:01.974251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13210): Launched 23:29:02.302691 run osmo-stp_10.42.42.5(pid=13211): Launched 23:29:02.425100 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:02.972638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13213): Launched 23:29:03.094157 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:03.361893 run patchelf(pid=13214): Launched 23:29:03.537901 run osmo-stp_10.42.42.5(pid=13211): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13211)] 23:29:03.672236 run osmo-stp_10.42.42.5(pid=13211): stdout: | (launched: 2022-12-13_23:29:02.239621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:03.809142 run osmo-stp_10.42.42.5(pid=13211): stderr: | [0;m[38;5;43m20221213232902436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232902436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232902436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232902437 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232902437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232902437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232902437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:03.945250 run osmo-stp_10.42.42.5(pid=13211): stdout: | (launched: 2022-12-13_23:29:02.239621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:04.075131 run osmo-stp_10.42.42.5(pid=13211): stderr: | [0;m[38;5;43m20221213232902436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232902436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232902436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232902437 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232902437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232902437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232902437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:04.229114 run patchelf(pid=13214): Terminating (SIGINT) 23:29:04.407359 run patchelf(pid=13214): Terminated: ok {rc=0} 23:29:04.535307 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13211): Process ended prematurely: osmo-stp_10.42.42.5(pid=13211) [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13211)] [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:29:04.545368 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:29:04.573836 run osmo-hlr_10.42.42.2(pid=13208): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13208)] 23:29:04.624353 run osmo-hlr_10.42.42.2(pid=13208): stdout: | (launched: 2022-12-13_23:29:00.951651) 23:29:04.676310 run osmo-hlr_10.42.42.2(pid=13208): stderr: | [0;m[1;31m20221213232901372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232901372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232901372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232901372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232901372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232901372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232901398 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232901421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232901421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232901421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:04.728718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13197): Terminating (SIGTERM) 23:29:04.770975 run iperf3-srv_10.42.42.10(pid=13198): Terminating (SIGTERM) 23:29:04.813457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13199): Terminating (SIGTERM) 23:29:04.855443 run iperf3-srv_10.42.42.10(pid=13200): Terminating (SIGTERM) 23:29:04.897783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13201): Terminating (SIGTERM) 23:29:04.940498 run iperf3-srv_10.42.42.10(pid=13202): Terminating (SIGTERM) 23:29:04.982541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13203): Terminating (SIGTERM) 23:29:05.025255 run iperf3-srv_10.42.42.10(pid=13204): Terminating (SIGTERM) 23:29:05.067174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13207): Terminating (SIGTERM) 23:29:05.109720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13210): Terminating (SIGTERM) 23:29:05.151902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13213): Terminating (SIGTERM) 23:29:05.194362 --- ParallelTerminationStrategy: PID 13197 died... 23:29:05.214599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13197): Terminated: ok {rc=0} 23:29:05.260871 --- ParallelTerminationStrategy: PID 13198 died... 23:29:05.281059 run iperf3-srv_10.42.42.10(pid=13198): Terminated {rc=256} 23:29:05.327110 --- ParallelTerminationStrategy: PID 13199 died... 23:29:05.346911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13199): Terminated: ok {rc=0} 23:29:05.393167 --- ParallelTerminationStrategy: PID 13200 died... 23:29:05.412730 run iperf3-srv_10.42.42.10(pid=13200): Terminated {rc=256} 23:29:05.458635 --- ParallelTerminationStrategy: PID 13201 died... 23:29:05.478413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13201): Terminated: ok {rc=0} 23:29:05.524351 --- ParallelTerminationStrategy: PID 13202 died... 23:29:05.544085 run iperf3-srv_10.42.42.10(pid=13202): Terminated {rc=256} 23:29:05.589987 --- ParallelTerminationStrategy: PID 13203 died... 23:29:05.609713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13203): Terminated: ok {rc=0} 23:29:05.655670 --- ParallelTerminationStrategy: PID 13204 died... 23:29:05.675477 run iperf3-srv_10.42.42.10(pid=13204): Terminated {rc=256} 23:29:05.721437 --- ParallelTerminationStrategy: PID 13207 died... 23:29:05.741368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13207): Terminated: ok {rc=0} 23:29:05.787940 --- ParallelTerminationStrategy: PID 13210 died... 23:29:05.807830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13210): Terminated: ok {rc=0} 23:29:05.853943 --- ParallelTerminationStrategy: PID 13213 died... 23:29:05.873850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13213): Terminated: ok {rc=0} 23:29:05.960627 bus /gobi_4: Setting Powered False 23:29:07.059579 bus /gobi_4: Setting Powered False 23:29:08.171624 bus /gobi_1: Setting Powered False 23:29:09.269717 bus /gobi_1: Setting Powered False 23:29:10.387830 bus /gobi_0: Setting Powered False 23:29:11.486418 bus /gobi_0: Setting Powered False 23:29:12.599082 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:29:13.701191 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:13.712869 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:29:13.773596 tst ping.py: using LAC 36971 23:29:13.888866 tst ping.py: using RAC 251 23:29:14.011635 tst ping.py: using CellId 36971 23:29:14.135039 tst ping.py: using BVCI 36972 23:29:14.247505 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:14.258944 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:14.270083 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:14.281074 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:14.292344 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:14.303586 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:14.315171 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:14.326543 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:29:14.442942 tst ping.py:19: start network... 23:29:14.652419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:15.132627 run create_hlr_db(pid=13216): Launched 23:29:15.250535 bus /gobi_6: Setting Powered False 23:29:16.311301 run create_hlr_db(pid=13216): Terminated: ok {rc=0} 23:29:16.783076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13218): Launched 23:29:17.126368 run osmo-hlr_10.42.42.2(pid=13219): Launched 23:29:17.255632 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:17.779599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13221): Launched 23:29:18.069862 run osmo-stp_10.42.42.5(pid=13222): Launched 23:29:18.180000 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:18.681087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13224): Launched 23:29:18.792630 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:19.039302 run patchelf(pid=13225): Launched 23:29:19.201578 run osmo-stp_10.42.42.5(pid=13222): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13222)] 23:29:19.325494 run osmo-stp_10.42.42.5(pid=13222): stdout: | (launched: 2022-12-13_23:29:18.016724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:19.451382 run osmo-stp_10.42.42.5(pid=13222): stderr: | [0;m[38;5;43m20221213232918185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232918185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232918186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232918186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232918187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232918187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232918187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:19.576797 run osmo-stp_10.42.42.5(pid=13222): stdout: | (launched: 2022-12-13_23:29:18.016724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:19.696854 run osmo-stp_10.42.42.5(pid=13222): stderr: | [0;m[38;5;43m20221213232918185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232918185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232918186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232918186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232918187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232918187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232918187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:19.838906 run patchelf(pid=13225): Terminating (SIGINT) 23:29:20.002230 run patchelf(pid=13225): Terminated: ok {rc=0} 23:29:20.119675 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13222): Process ended prematurely: osmo-stp_10.42.42.5(pid=13222) [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13222)] [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 23:29:20.128403 tst ping.py:22: Test FAILED (6.4 sec) 23:29:20.154959 run osmo-hlr_10.42.42.2(pid=13219): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13219)] 23:29:20.203013 run osmo-hlr_10.42.42.2(pid=13219): stdout: | (launched: 2022-12-13_23:29:17.054946) 23:29:20.252629 run osmo-hlr_10.42.42.2(pid=13219): stderr: | [0;m[1;31m20221213232917316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232917316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232917316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232917316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232917316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232917316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232917336 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232917345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232917346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232917346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:20.302544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13218): Terminating (SIGTERM) 23:29:20.342731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13221): Terminating (SIGTERM) 23:29:20.382698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13224): Terminating (SIGTERM) 23:29:20.422958 --- ParallelTerminationStrategy: PID 13218 died... 23:29:20.442368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13218): Terminated: ok {rc=0} 23:29:20.486885 --- ParallelTerminationStrategy: PID 13221 died... 23:29:20.505777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13221): Terminated: ok {rc=0} 23:29:20.549902 --- ParallelTerminationStrategy: PID 13224 died... 23:29:20.568801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13224): Terminated: ok {rc=0} 23:29:20.654838 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:29:21.743634 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:21.754997 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:29:21.813216 tst ping_idle_ping.py: using LAC 36972 23:29:21.930434 tst ping_idle_ping.py: using RAC 252 23:29:22.049687 tst ping_idle_ping.py: using CellId 36972 23:29:22.165365 tst ping_idle_ping.py: using BVCI 36973 23:29:22.274721 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:22.285662 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:22.296177 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:22.306743 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:22.317402 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:22.328915 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:22.340215 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:22.350833 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:29:22.469352 tst ping_idle_ping.py:24: start network... 23:29:22.681686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:23.173574 run create_hlr_db(pid=13226): Launched 23:29:23.293626 bus /gobi_6: Setting Powered False 23:29:24.355260 run create_hlr_db(pid=13226): Terminated: ok {rc=0} 23:29:24.774520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13228): Launched 23:29:25.065724 run osmo-hlr_10.42.42.2(pid=13229): Launched 23:29:25.177359 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:25.697373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13231): Launched 23:29:25.988404 run osmo-stp_10.42.42.5(pid=13232): Launched 23:29:26.099639 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:26.602398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13234): Launched 23:29:26.713522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:26.960062 run patchelf(pid=13235): Launched 23:29:27.122621 run osmo-stp_10.42.42.5(pid=13232): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13232)] 23:29:27.246253 run osmo-stp_10.42.42.5(pid=13232): stdout: | (launched: 2022-12-13_23:29:25.935210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:27.371521 run osmo-stp_10.42.42.5(pid=13232): stderr: | [0;m[38;5;43m20221213232926103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232926103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232926103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232926104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232926104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232926104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232926104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:27.496684 run osmo-stp_10.42.42.5(pid=13232): stdout: | (launched: 2022-12-13_23:29:25.935210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:27.616262 run osmo-stp_10.42.42.5(pid=13232): stderr: | [0;m[38;5;43m20221213232926103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232926103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232926103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232926104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232926104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232926104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232926104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:27.758111 run patchelf(pid=13235): Terminating (SIGINT) 23:29:27.921678 run patchelf(pid=13235): Terminated: ok {rc=0} 23:29:28.039387 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13232): Process ended prematurely: osmo-stp_10.42.42.5(pid=13232) [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13232)] [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:29:28.048141 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 23:29:28.074365 run osmo-hlr_10.42.42.2(pid=13229): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13229)] 23:29:28.122247 run osmo-hlr_10.42.42.2(pid=13229): stdout: | (launched: 2022-12-13_23:29:25.012256) 23:29:28.171338 run osmo-hlr_10.42.42.2(pid=13229): stderr: | [0;m[1;31m20221213232925188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232925188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232925188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232925188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232925188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232925188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232925200 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232925209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232925209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232925209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:28.220789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13228): Terminating (SIGTERM) 23:29:28.260544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13231): Terminating (SIGTERM) 23:29:28.300188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13234): Terminating (SIGTERM) 23:29:28.340176 --- ParallelTerminationStrategy: PID 13228 died... 23:29:28.359257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13228): Terminated: ok {rc=0} 23:29:28.403228 --- ParallelTerminationStrategy: PID 13231 died... 23:29:28.421702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13231): Terminated: ok {rc=0} 23:29:28.465418 --- ParallelTerminationStrategy: PID 13234 died... 23:29:28.483994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13234): Terminated: ok {rc=0} 23:29:28.566809 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:29:29.859299 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:29.866534 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:29:29.887460 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:29:29.923373 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:29:29.978652 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:29:29.998954 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:29:30.032777 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:29:30.589168 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:29:30.594410 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:30.605658 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:29:30.661085 tst switch_tch_pdch.py: using LAC 36973 23:29:30.784400 tst switch_tch_pdch.py: using RAC 253 23:29:30.917359 tst switch_tch_pdch.py: using CellId 36973 23:29:31.053049 tst switch_tch_pdch.py: using BVCI 36974 23:29:31.199568 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:31.212464 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:31.224625 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:31.236938 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:31.250075 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:31.262578 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:31.274942 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:31.287393 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:29:31.407318 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:29:31.527138 tst switch_tch_pdch.py:51: start network... 23:29:31.734689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:32.202948 run create_hlr_db(pid=13240): Launched 23:29:32.341349 bus /gobi_6: Setting Powered False 23:29:33.399477 run create_hlr_db(pid=13240): Terminated: ok {rc=0} 23:29:33.806712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13242): Launched 23:29:34.096384 run osmo-hlr_10.42.42.2(pid=13243): Launched 23:29:34.206362 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:34.705947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13245): Launched 23:29:34.995110 run osmo-stp_10.42.42.5(pid=13246): Launched 23:29:35.104448 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:35.605711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13248): Launched 23:29:35.716284 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:35.961118 run patchelf(pid=13249): Launched 23:29:36.121602 run osmo-stp_10.42.42.5(pid=13246): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13246)] 23:29:36.244624 run osmo-stp_10.42.42.5(pid=13246): stdout: | (launched: 2022-12-13_23:29:34.942494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:36.369790 run osmo-stp_10.42.42.5(pid=13246): stderr: | [0;m[38;5;43m20221213232935111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232935111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232935111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232935112 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232935114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232935114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232935114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:36.494637 run osmo-stp_10.42.42.5(pid=13246): stdout: | (launched: 2022-12-13_23:29:34.942494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:36.614932 run osmo-stp_10.42.42.5(pid=13246): stderr: | [0;m[38;5;43m20221213232935111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232935111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232935111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232935112 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232935114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232935114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232935114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:36.756180 run patchelf(pid=13249): Terminating (SIGINT) 23:29:36.919931 run patchelf(pid=13249): Terminated: ok {rc=0} 23:29:37.037993 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13246): Process ended prematurely: osmo-stp_10.42.42.5(pid=13246) [trial-2396↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13246)] [trial-2396↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:29:37.046776 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 23:29:37.073275 run osmo-hlr_10.42.42.2(pid=13243): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13243)] 23:29:37.120908 run osmo-hlr_10.42.42.2(pid=13243): stdout: | (launched: 2022-12-13_23:29:34.043465) 23:29:37.170558 run osmo-hlr_10.42.42.2(pid=13243): stderr: | [0;m[1;31m20221213232934219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232934219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232934219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232934219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232934219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232934219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232934236 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232934245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232934245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232934245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:37.220476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13242): Terminating (SIGTERM) 23:29:37.260111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13245): Terminating (SIGTERM) 23:29:37.299588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13248): Terminating (SIGTERM) 23:29:37.339255 --- ParallelTerminationStrategy: PID 13242 died... 23:29:37.358580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13242): Terminated: ok {rc=0} 23:29:37.402482 --- ParallelTerminationStrategy: PID 13245 died... 23:29:37.421190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13245): Terminated: ok {rc=0} 23:29:37.464821 --- ParallelTerminationStrategy: PID 13248 died... 23:29:37.483868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13248): Terminated: ok {rc=0} 23:29:37.569111 bus /gobi_0: Setting Powered False 23:29:38.666839 bus /gobi_0: Setting Powered False 23:29:39.782245 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:29:41.016555 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:41.022075 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:29:41.042098 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:29:41.076117 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:29:41.127869 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:29:41.148342 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:29:41.181954 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:29:41.737957 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:29:41.743135 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:41.754081 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:29:41.811336 tst switch_tch_pdch.py: using LAC 36974 23:29:41.928458 tst switch_tch_pdch.py: using RAC 254 23:29:42.042633 tst switch_tch_pdch.py: using CellId 36974 23:29:42.157399 tst switch_tch_pdch.py: using BVCI 36975 23:29:42.264439 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:42.275269 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:42.285842 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:42.296321 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:42.306748 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:42.317830 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:42.329348 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:42.340028 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:29:42.458802 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:29:42.574471 tst switch_tch_pdch.py:51: start network... 23:29:42.786128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:43.241814 run create_hlr_db(pid=13253): Launched 23:29:43.360755 bus /gobi_6: Setting Powered False 23:29:44.422702 run create_hlr_db(pid=13253): Terminated: ok {rc=0} 23:29:44.815641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13255): Launched 23:29:45.106067 run osmo-hlr_10.42.42.2(pid=13256): Launched 23:29:45.216820 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:45.691273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13258): Launched 23:29:46.004623 run osmo-stp_10.42.42.5(pid=13259): Launched 23:29:46.294468 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:46.836102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13261): Launched 23:29:46.951549 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:47.207513 run patchelf(pid=13262): Launched 23:29:47.408624 run osmo-stp_10.42.42.5(pid=13259): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13259)] 23:29:47.540880 run osmo-stp_10.42.42.5(pid=13259): stdout: | (launched: 2022-12-13_23:29:45.939016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:47.674417 run osmo-stp_10.42.42.5(pid=13259): stderr: | [0;m[38;5;43m20221213232946155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232946155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232946156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232946156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232946158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232946158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232946158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:47.808482 run osmo-stp_10.42.42.5(pid=13259): stdout: | (launched: 2022-12-13_23:29:45.939016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:47.936264 run osmo-stp_10.42.42.5(pid=13259): stderr: | [0;m[38;5;43m20221213232946155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213232946155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213232946156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213232946156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213232946158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213232946158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213232946158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:48.087787 run patchelf(pid=13262): Terminating (SIGINT) 23:29:48.261667 run patchelf(pid=13262): Terminated: ok {rc=0} 23:29:48.386757 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13259): Process ended prematurely: osmo-stp_10.42.42.5(pid=13259) [trial-2396↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13259)] [trial-2396↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:29:48.396246 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 23:29:48.423975 run osmo-hlr_10.42.42.2(pid=13256): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13256)] 23:29:48.474789 run osmo-hlr_10.42.42.2(pid=13256): stdout: | (launched: 2022-12-13_23:29:45.053682) 23:29:48.526991 run osmo-hlr_10.42.42.2(pid=13256): stderr: | [0;m[1;31m20221213232945226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213232945226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213232945226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213232945226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213232945226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213232945226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213232945238 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213232945247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213232945247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213232945247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:48.580179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13255): Terminating (SIGTERM) 23:29:48.622245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13258): Terminating (SIGTERM) 23:29:48.664908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13261): Terminating (SIGTERM) 23:29:48.707535 --- ParallelTerminationStrategy: PID 13255 died... 23:29:48.727851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13255): Terminated: ok {rc=0} 23:29:48.775125 --- ParallelTerminationStrategy: PID 13258 died... 23:29:48.795026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13258): Terminated: ok {rc=0} 23:29:48.841483 --- ParallelTerminationStrategy: PID 13261 died... 23:29:48.861453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13261): Terminated: ok {rc=0} 23:29:48.950133 bus /gobi_0: Setting Powered False 23:29:50.049410 bus /gobi_0: Setting Powered False 23:29:51.165235 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_sms:trx-b200 --------------------------------------------------------------------- 23:29:52.395875 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:52.399498 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 23:29:52.431746 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 23:29:52.438373 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 23:29:52.487750 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 23:29:52.519963 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 23:29:52.526718 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 23:29:53.069468 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 23:29:53.074334 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 23:29:53.085069 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 23:29:53.132663 tst mo_mt_sms.py: using LAC 36975 23:29:53.246185 tst mo_mt_sms.py: using RAC 255 23:29:53.358494 tst mo_mt_sms.py: using CellId 36975 23:29:53.471083 tst mo_mt_sms.py: using BVCI 36976 23:29:53.575874 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 23:29:53.693375 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 23:29:53.806878 tst mo_mt_sms.py:9: start nitb and bts... 23:29:54.002080 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:29:54.595349 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13268): Launched 23:29:54.884937 run osmo-nitb_10.42.42.2(pid=13269): Launched 23:29:55.045992 run osmo-nitb_10.42.42.2(pid=13269): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13269)] 23:29:55.176942 run osmo-nitb_10.42.42.2(pid=13269): stdout: | (launched: 2022-12-13_23:29:54.832019) 23:29:55.309901 run osmo-nitb_10.42.42.2(pid=13269): stderr: | (launched: 2022-12-13_23:29:54.875257) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:29:55.443031 run osmo-nitb_10.42.42.2(pid=13269): stdout: | (launched: 2022-12-13_23:29:54.832019) 23:29:55.569798 run osmo-nitb_10.42.42.2(pid=13269): stderr: | (launched: 2022-12-13_23:29:54.875257) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13269): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13269) [trial-2396↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13269)] 23:29:55.994751 tst osmo-nitb_10.42.42.2(pid=13269): stdout: | (launched: 2022-12-13_23:29:54.832019) 23:29:56.112888 tst osmo-nitb_10.42.42.2(pid=13269): stderr: | (launched: 2022-12-13_23:29:54.875257) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:29:56.251069 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=13269): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13269) [trial-2396↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13269)] [trial-2396↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 23:29:56.259310 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 23:29:56.265721 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13268): Terminating (SIGTERM) 23:29:56.473700 --- ParallelTerminationStrategy: PID 13268 died... 23:29:56.494679 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13268): Terminated: ok {rc=0} 23:29:56.577643 bus /sierra_3: Setting Powered False 23:29:57.675935 bus /sierra_3: Setting Powered False 23:29:58.793429 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 sms:trx-b200 --------------------------------------------------------------------- 23:29:59.986098 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:59.991133 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 23:30:00.026073 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 23:30:00.053844 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 23:30:00.107132 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 23:30:00.141172 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 23:30:00.168670 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 23:30:00.714692 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 23:30:00.719763 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:00.730656 tst sms:trx-b200: Using 1 x bts (candidates: 1) 23:30:00.778465 tst mo_mt_sms.py: using LAC 36976 23:30:00.903349 tst mo_mt_sms.py: using RAC 1 23:30:01.035469 tst mo_mt_sms.py: using CellId 36976 23:30:01.189179 tst mo_mt_sms.py: using BVCI 36977 23:30:01.304703 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:01.316880 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:01.328783 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:01.340552 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:01.353820 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:01.366898 tst sms:trx-b200: Using 1 x modem (candidates: 2) 23:30:01.493072 tst sms:trx-b200: Using 1 x modem (candidates: 2) 23:30:01.645466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:02.166987 run create_hlr_db(pid=13281): Launched 23:30:02.320491 bus /sierra_2: Setting Powered False 23:30:03.379970 run create_hlr_db(pid=13281): Terminated: ok {rc=0} 23:30:03.806910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13283): Launched 23:30:04.116713 run osmo-hlr_10.42.42.2(pid=13284): Launched 23:30:04.235324 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:04.771048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13286): Launched 23:30:05.080894 run osmo-stp_10.42.42.5(pid=13287): Launched 23:30:05.199007 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:05.762191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13289): Launched 23:30:06.072049 run osmo-msc_10.42.42.6(pid=13290): Launched 23:30:06.245694 run osmo-stp_10.42.42.5(pid=13287): ERR: Terminated: ERROR {rc=1} [trial-2396↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13287)] 23:30:06.377594 run osmo-stp_10.42.42.5(pid=13287): stdout: | (launched: 2022-12-13_23:30:05.025083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:06.510517 run osmo-stp_10.42.42.5(pid=13287): stderr: | [0;m[38;5;43m20221213233005213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233005213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233005214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233005214 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233005214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233005214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233005215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:06.642522 run osmo-stp_10.42.42.5(pid=13287): stdout: | (launched: 2022-12-13_23:30:05.025083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:06.766371 run osmo-stp_10.42.42.5(pid=13287): stderr: | [0;m[38;5;43m20221213233005213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233005213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233005214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233005214 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233005214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233005214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233005215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:06.914613 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=13287): Process ended prematurely: osmo-stp_10.42.42.5(pid=13287) [trial-2396↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13287)] [trial-2396↪sms:trx-b200↪mo_mt_sms.py:16] 23:30:06.923173 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 23:30:06.950083 run osmo-hlr_10.42.42.2(pid=13284): ERR: Terminated: ERROR {rc=237} [trial-2396↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13284)] 23:30:07.000819 run osmo-hlr_10.42.42.2(pid=13284): stdout: | (launched: 2022-12-13_23:30:04.060668) 23:30:07.053271 run osmo-hlr_10.42.42.2(pid=13284): stderr: | [0;m[1;31m20221213233004257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233004257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233004257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233004257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233004257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233004257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233004270 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233004278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233004278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233004278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:07.125405 run osmo-msc_10.42.42.6(pid=13290): ERR: Terminated: ERROR {rc=2} [trial-2396↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13290)] 23:30:07.175284 run osmo-msc_10.42.42.6(pid=13290): stdout: | (launched: 2022-12-13_23:30:06.015927) 23:30:07.227053 run osmo-msc_10.42.42.6(pid=13290): stderr: | [0;m[38;5;43m20221213233006337 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233006337 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff0b9d59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233006337 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233006337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233006337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233006338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233006339 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233006340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233006340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233006340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:07.279416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13283): Terminating (SIGTERM) 23:30:07.321192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13286): Terminating (SIGTERM) 23:30:07.363407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13289): Terminating (SIGTERM) 23:30:07.405285 --- ParallelTerminationStrategy: PID 13283 died... 23:30:07.425567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13283): Terminated: ok {rc=0} 23:30:07.471794 --- ParallelTerminationStrategy: PID 13286 died... 23:30:07.491435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13286): Terminated: ok {rc=0} 23:30:07.537827 --- ParallelTerminationStrategy: PID 13289 died... 23:30:07.557481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13289): Terminated: ok {rc=0} 23:30:07.645619 bus /sierra_3: Setting Powered False 23:30:08.744352 bus /sierra_3: Setting Powered False 23:30:09.861424 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_ussd:trx-b200 --------------------------------------------------------------------- 23:30:11.090550 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:11.094921 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 23:30:11.128105 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 23:30:11.135580 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 23:30:11.170655 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 23:30:11.205268 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 23:30:11.212446 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 23:30:11.730941 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2396 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 23:30:11.736448 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 23:30:11.747532 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 23:30:11.796771 tst assert_extension.py: using LAC 36977 23:30:11.914471 tst assert_extension.py: using RAC 2 23:30:12.027804 tst assert_extension.py: using CellId 36977 23:30:12.140261 tst assert_extension.py: using BVCI 36978 23:30:12.244905 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 23:30:12.361848 tst assert_extension.py:10: start nitb and bts... 23:30:12.570779 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:30:13.204748 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13295): Launched 23:30:13.514648 run osmo-nitb_10.42.42.2(pid=13296): Launched 23:30:13.686217 run osmo-nitb_10.42.42.2(pid=13296): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13296)] 23:30:13.826594 run osmo-nitb_10.42.42.2(pid=13296): stdout: | (launched: 2022-12-13_23:30:13.458432) 23:30:13.968150 run osmo-nitb_10.42.42.2(pid=13296): stderr: | (launched: 2022-12-13_23:30:13.504873) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:30:14.109711 run osmo-nitb_10.42.42.2(pid=13296): stdout: | (launched: 2022-12-13_23:30:13.458432) 23:30:14.245502 run osmo-nitb_10.42.42.2(pid=13296): stderr: | (launched: 2022-12-13_23:30:13.504873) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13296): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13296) [trial-2396↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13296)] 23:30:14.631214 tst osmo-nitb_10.42.42.2(pid=13296): stdout: | (launched: 2022-12-13_23:30:13.458432) 23:30:14.756746 tst osmo-nitb_10.42.42.2(pid=13296): stderr: | (launched: 2022-12-13_23:30:13.504873) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:30:14.905288 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=13296): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13296) [trial-2396↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13296)] [trial-2396↪nitb_ussd:trx-b200↪assert_extension.py:12] 23:30:14.914408 tst assert_extension.py:12: Test FAILED (3.2 sec) 23:30:14.921509 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13295): Terminating (SIGTERM) 23:30:15.132482 --- ParallelTerminationStrategy: PID 13295 died... 23:30:15.154043 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13295): Terminated: ok {rc=0} 23:30:15.242231 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 ussd:trx-b200 --------------------------------------------------------------------- 23:30:16.442191 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:16.447271 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 23:30:16.483663 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 23:30:16.512790 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 23:30:16.550692 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 23:30:16.585410 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 23:30:16.613837 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 23:30:17.181182 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2396 ussd:trx-b200 assert_extension.py ---------------------------------------------- 23:30:17.188187 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:17.200150 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 23:30:17.254354 tst assert_extension.py: using LAC 36978 23:30:17.376761 tst assert_extension.py: using RAC 3 23:30:17.490586 tst assert_extension.py: using CellId 36978 23:30:17.605313 tst assert_extension.py: using BVCI 36979 23:30:17.710023 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:17.720425 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:17.730756 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:17.741157 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:17.751846 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:17.762329 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 23:30:17.875762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:18.358679 run create_hlr_db(pid=13300): Launched 23:30:18.478021 bus /sierra_2: Setting Powered False 23:30:19.540288 run create_hlr_db(pid=13300): Terminated: ok {rc=0} 23:30:19.958396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13302): Launched 23:30:20.247722 run osmo-hlr_10.42.42.2(pid=13303): Launched 23:30:20.358753 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:20.877806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13305): Launched 23:30:21.167216 run osmo-stp_10.42.42.5(pid=13306): Launched 23:30:21.277683 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:21.801859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13308): Launched 23:30:22.090145 run osmo-msc_10.42.42.6(pid=13309): Launched 23:30:22.251091 run osmo-stp_10.42.42.5(pid=13306): ERR: Terminated: ERROR {rc=1} [trial-2396↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13306)] 23:30:22.373965 run osmo-stp_10.42.42.5(pid=13306): stdout: | (launched: 2022-12-13_23:30:21.114320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:22.496849 run osmo-stp_10.42.42.5(pid=13306): stderr: | [0;m[38;5;43m20221213233021283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233021283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233021283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233021284 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233021284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233021284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233021284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:22.617803 run osmo-stp_10.42.42.5(pid=13306): stdout: | (launched: 2022-12-13_23:30:21.114320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:22.733553 run osmo-stp_10.42.42.5(pid=13306): stderr: | [0;m[38;5;43m20221213233021283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233021283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233021283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233021284 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233021284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233021284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233021284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:22.871228 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=13306): Process ended prematurely: osmo-stp_10.42.42.5(pid=13306) [trial-2396↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13306)] [trial-2396↪ussd:trx-b200↪assert_extension.py:17] 23:30:22.879496 tst assert_extension.py:17: Test FAILED (5.7 sec) 23:30:22.905274 run osmo-hlr_10.42.42.2(pid=13303): ERR: Terminated: ERROR {rc=237} [trial-2396↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13303)] 23:30:22.953279 run osmo-hlr_10.42.42.2(pid=13303): stdout: | (launched: 2022-12-13_23:30:20.194972) 23:30:23.002359 run osmo-hlr_10.42.42.2(pid=13303): stderr: | [0;m[1;31m20221213233020368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233020368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233020368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233020368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233020368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233020368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233020381 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233020389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233020389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233020389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:23.070754 run osmo-msc_10.42.42.6(pid=13309): ERR: Terminated: ERROR {rc=2} [trial-2396↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13309)] 23:30:23.118058 run osmo-msc_10.42.42.6(pid=13309): stdout: | (launched: 2022-12-13_23:30:22.037522) 23:30:23.166911 run osmo-msc_10.42.42.6(pid=13309): stderr: | [0;m[38;5;43m20221213233022306 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233022307 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd3b5877c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233022307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233022307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233022307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233022307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233022311 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233022311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233022311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233022311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:23.216389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13302): Terminating (SIGTERM) 23:30:23.255756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13305): Terminating (SIGTERM) 23:30:23.295045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13308): Terminating (SIGTERM) 23:30:23.334714 --- ParallelTerminationStrategy: PID 13302 died... 23:30:23.353812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13302): Terminated: ok {rc=0} 23:30:23.397734 --- ParallelTerminationStrategy: PID 13305 died... 23:30:23.416338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13305): Terminated: ok {rc=0} 23:30:23.460061 --- ParallelTerminationStrategy: PID 13308 died... 23:30:23.478609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13308): Terminated: ok {rc=0} 23:30:23.561982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:30:24.781972 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:24.789521 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:30:24.821772 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:30:24.849238 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:30:24.899518 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:30:24.933811 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:30:24.961578 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:30:25.509751 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:30:25.559993 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:25.571037 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:30:25.642231 tst mo_mt_call.py: using LAC 36979 23:30:25.759897 tst mo_mt_call.py: using RAC 4 23:30:25.884169 tst mo_mt_call.py: using CellId 36979 23:30:25.998809 tst mo_mt_call.py: using BVCI 36980 23:30:26.106343 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:26.117366 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:26.128087 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:26.138878 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:26.150199 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:26.161647 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:30:26.281359 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:30:26.397504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:26.856323 run create_hlr_db(pid=13314): Launched 23:30:26.976749 bus /sierra_2: Setting Powered False 23:30:28.036405 run create_hlr_db(pid=13314): Terminated: ok {rc=0} 23:30:28.469414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13316): Launched 23:30:28.785515 run osmo-hlr_10.42.42.2(pid=13317): Launched 23:30:28.906923 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:29.450474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13319): Launched 23:30:29.766635 run osmo-stp_10.42.42.5(pid=13320): Launched 23:30:29.887424 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:30.460018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13322): Launched 23:30:30.761186 run osmo-msc_10.42.42.6(pid=13323): Launched 23:30:31.049253 run osmo-stp_10.42.42.5(pid=13320): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13320)] 23:30:31.305840 run osmo-stp_10.42.42.5(pid=13320): stdout: | (launched: 2022-12-13_23:30:29.709677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:31.554465 run osmo-stp_10.42.42.5(pid=13320): stderr: | [0;m[38;5;43m20221213233029899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233029899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233029899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233029900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233029900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233029900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233029900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:31.691083 run osmo-stp_10.42.42.5(pid=13320): stdout: | (launched: 2022-12-13_23:30:29.709677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:31.824732 run osmo-stp_10.42.42.5(pid=13320): stderr: | [0;m[38;5;43m20221213233029899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233029899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233029899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233029900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233029900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233029900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233029900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:31.982015 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13320): Process ended prematurely: osmo-stp_10.42.42.5(pid=13320) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13320)] [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:30:31.992484 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 23:30:32.022792 run osmo-hlr_10.42.42.2(pid=13317): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13317)] 23:30:32.077472 run osmo-hlr_10.42.42.2(pid=13317): stdout: | (launched: 2022-12-13_23:30:28.728547) 23:30:32.133452 run osmo-hlr_10.42.42.2(pid=13317): stderr: | [0;m[1;31m20221213233028923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233028923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233028923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233028924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233028924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233028924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233028938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233028949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233028949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233028949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:32.208750 run osmo-msc_10.42.42.6(pid=13323): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13323)] 23:30:32.261535 run osmo-msc_10.42.42.6(pid=13323): stdout: | (launched: 2022-12-13_23:30:30.706864) 23:30:32.314220 run osmo-msc_10.42.42.6(pid=13323): stderr: | [0;m[38;5;43m20221213233031083 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233031083 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4e352d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233031083 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233031083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233031084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233031084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233031089 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233031092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233031092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233031093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:32.364295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13316): Terminating (SIGTERM) 23:30:32.404072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13319): Terminating (SIGTERM) 23:30:32.443649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13322): Terminating (SIGTERM) 23:30:32.483350 --- ParallelTerminationStrategy: PID 13316 died... 23:30:32.502276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13316): Terminated: ok {rc=0} 23:30:32.546051 --- ParallelTerminationStrategy: PID 13319 died... 23:30:32.564441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13319): Terminated: ok {rc=0} 23:30:32.608289 --- ParallelTerminationStrategy: PID 13322 died... 23:30:32.627056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13322): Terminated: ok {rc=0} 23:30:32.712197 bus /sierra_3: Setting Powered False 23:30:33.811463 bus /sierra_3: Setting Powered False 23:30:34.926621 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:30:36.070247 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:36.081851 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:30:36.150278 tst mo_mt_call_osmux.py: using LAC 36980 23:30:36.268347 tst mo_mt_call_osmux.py: using RAC 5 23:30:36.384907 tst mo_mt_call_osmux.py: using CellId 36980 23:30:36.501319 tst mo_mt_call_osmux.py: using BVCI 36981 23:30:36.608474 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:36.619472 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:36.630284 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:36.641068 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:36.651928 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:36.662833 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:30:36.780411 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:30:36.896605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:37.354199 run create_hlr_db(pid=13325): Launched 23:30:37.474330 bus /sierra_2: Setting Powered False 23:30:38.533738 run create_hlr_db(pid=13325): Terminated: ok {rc=0} 23:30:38.967217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13327): Launched 23:30:39.283186 run osmo-hlr_10.42.42.2(pid=13328): Launched 23:30:39.404115 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:39.948921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13330): Launched 23:30:40.264118 run osmo-stp_10.42.42.5(pid=13331): Launched 23:30:40.385367 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:40.957350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13333): Launched 23:30:41.272390 run osmo-msc_10.42.42.6(pid=13334): Launched 23:30:41.449072 run osmo-stp_10.42.42.5(pid=13331): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13331)] 23:30:41.583299 run osmo-stp_10.42.42.5(pid=13331): stdout: | (launched: 2022-12-13_23:30:40.207210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:41.717909 run osmo-stp_10.42.42.5(pid=13331): stderr: | [0;m[38;5;43m20221213233040398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233040398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233040398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233040398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233040399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233040399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233040399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:41.852198 run osmo-stp_10.42.42.5(pid=13331): stdout: | (launched: 2022-12-13_23:30:40.207210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:41.978821 run osmo-stp_10.42.42.5(pid=13331): stderr: | [0;m[38;5;43m20221213233040398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233040398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233040398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233040398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233040399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233040399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233040399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:42.130136 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13331): Process ended prematurely: osmo-stp_10.42.42.5(pid=13331) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13331)] [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:30:42.139905 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:30:42.167560 run osmo-hlr_10.42.42.2(pid=13328): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13328)] 23:30:42.218591 run osmo-hlr_10.42.42.2(pid=13328): stdout: | (launched: 2022-12-13_23:30:39.226370) 23:30:42.271108 run osmo-hlr_10.42.42.2(pid=13328): stderr: | [0;m[1;31m20221213233039421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233039421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233039421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233039421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233039421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233039421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233039436 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233039446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233039446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233039446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:42.343791 run osmo-msc_10.42.42.6(pid=13334): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13334)] 23:30:42.393810 run osmo-msc_10.42.42.6(pid=13334): stdout: | (launched: 2022-12-13_23:30:41.215708) 23:30:42.445896 run osmo-msc_10.42.42.6(pid=13334): stderr: | [0;m[38;5;43m20221213233041537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233041537 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff1c8c09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233041537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233041537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233041537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233041538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233041539 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233041540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233041540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233041540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:42.498144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13327): Terminating (SIGTERM) 23:30:42.540224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13330): Terminating (SIGTERM) 23:30:42.582478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13333): Terminating (SIGTERM) 23:30:42.625135 --- ParallelTerminationStrategy: PID 13327 died... 23:30:42.645472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13327): Terminated: ok {rc=0} 23:30:42.691970 --- ParallelTerminationStrategy: PID 13330 died... 23:30:42.712007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13330): Terminated: ok {rc=0} 23:30:42.758336 --- ParallelTerminationStrategy: PID 13333 died... 23:30:42.778279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13333): Terminated: ok {rc=0} 23:30:42.866744 bus /sierra_3: Setting Powered False 23:30:43.962723 bus /sierra_3: Setting Powered False 23:30:45.079186 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:30:46.358483 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:46.368095 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:30:46.408357 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:30:46.440880 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:30:46.503276 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:30:46.552531 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:30:46.581895 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:30:47.128886 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:30:47.187977 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:47.199432 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:30:47.268591 tst mo_mt_call.py: using LAC 36981 23:30:47.393442 tst mo_mt_call.py: using RAC 6 23:30:47.518497 tst mo_mt_call.py: using CellId 36981 23:30:47.642330 tst mo_mt_call.py: using BVCI 36982 23:30:47.757510 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:47.768940 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:47.780439 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:47.791629 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:47.803677 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:47.815983 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:30:47.931843 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:30:48.051145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:48.538994 run create_hlr_db(pid=13339): Launched 23:30:48.658451 bus /sierra_2: Setting Powered False 23:30:49.721195 run create_hlr_db(pid=13339): Terminated: ok {rc=0} 23:30:50.160694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13341): Launched 23:30:50.475028 run osmo-hlr_10.42.42.2(pid=13342): Launched 23:30:50.595912 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:51.140354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13344): Launched 23:30:51.454527 run osmo-stp_10.42.42.5(pid=13345): Launched 23:30:51.574768 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:52.147514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13347): Launched 23:30:52.461691 run osmo-msc_10.42.42.6(pid=13348): Launched 23:30:52.637637 run osmo-stp_10.42.42.5(pid=13345): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13345)] 23:30:52.771135 run osmo-stp_10.42.42.5(pid=13345): stdout: | (launched: 2022-12-13_23:30:51.397903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:52.905881 run osmo-stp_10.42.42.5(pid=13345): stderr: | [0;m[38;5;43m20221213233051587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233051588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233051588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233051588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233051589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233051589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233051589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:53.039132 run osmo-stp_10.42.42.5(pid=13345): stdout: | (launched: 2022-12-13_23:30:51.397903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:53.164907 run osmo-stp_10.42.42.5(pid=13345): stderr: | [0;m[38;5;43m20221213233051587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233051588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233051588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233051588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233051589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233051589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233051589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:53.315323 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13345): Process ended prematurely: osmo-stp_10.42.42.5(pid=13345) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13345)] [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:30:53.324714 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:30:53.352049 run osmo-hlr_10.42.42.2(pid=13342): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13342)] 23:30:53.402319 run osmo-hlr_10.42.42.2(pid=13342): stdout: | (launched: 2022-12-13_23:30:50.418134) 23:30:53.453803 run osmo-hlr_10.42.42.2(pid=13342): stderr: | [0;m[1;31m20221213233050617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233050617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233050617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233050618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233050618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233050618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233050635 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233050645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233050646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233050646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:53.525648 run osmo-msc_10.42.42.6(pid=13348): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13348)] 23:30:53.575104 run osmo-msc_10.42.42.6(pid=13348): stdout: | (launched: 2022-12-13_23:30:52.404874) 23:30:53.626571 run osmo-msc_10.42.42.6(pid=13348): stderr: | [0;m[38;5;43m20221213233052723 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233052723 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faa83d7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233052723 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233052723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233052723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233052723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233052725 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233052726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233052726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233052726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:53.678575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13341): Terminating (SIGTERM) 23:30:53.719655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13344): Terminating (SIGTERM) 23:30:53.761019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13347): Terminating (SIGTERM) 23:30:53.802892 --- ParallelTerminationStrategy: PID 13341 died... 23:30:53.823237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13341): Terminated: ok {rc=0} 23:30:53.869229 --- ParallelTerminationStrategy: PID 13344 died... 23:30:53.888791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13344): Terminated: ok {rc=0} 23:30:53.934925 --- ParallelTerminationStrategy: PID 13347 died... 23:30:53.954649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13347): Terminated: ok {rc=0} 23:30:54.042886 bus /sierra_3: Setting Powered False 23:30:55.141721 bus /sierra_3: Setting Powered False 23:30:56.258524 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:30:57.403080 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:57.414763 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:30:57.488123 tst mo_mt_call_osmux.py: using LAC 36982 23:30:57.604109 tst mo_mt_call_osmux.py: using RAC 7 23:30:57.719030 tst mo_mt_call_osmux.py: using CellId 36982 23:30:57.834884 tst mo_mt_call_osmux.py: using BVCI 36983 23:30:57.943279 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:57.954324 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:57.965162 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:57.976016 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:57.986912 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:57.997741 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:30:58.111330 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:30:58.231134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:58.721851 run create_hlr_db(pid=13350): Launched 23:30:58.843644 bus /sierra_2: Setting Powered False 23:30:59.907398 run create_hlr_db(pid=13350): Terminated: ok {rc=0} 23:31:00.332822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13353): Launched 23:31:00.629914 run osmo-hlr_10.42.42.2(pid=13354): Launched 23:31:00.744328 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:01.400209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13356): Launched 23:31:01.719927 run osmo-stp_10.42.42.5(pid=13357): Launched 23:31:02.025349 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:02.611140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13359): Launched 23:31:02.907480 run osmo-msc_10.42.42.6(pid=13360): Launched 23:31:03.073223 run osmo-stp_10.42.42.5(pid=13357): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13357)] 23:31:03.198998 run osmo-stp_10.42.42.5(pid=13357): stdout: | (launched: 2022-12-13_23:31:01.651007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:03.325707 run osmo-stp_10.42.42.5(pid=13357): stderr: | [0;m[38;5;43m20221213233101966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233101966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233101967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233101972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233101975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233101975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233101975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:03.449728 run osmo-stp_10.42.42.5(pid=13357): stdout: | (launched: 2022-12-13_23:31:01.651007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:03.567925 run osmo-stp_10.42.42.5(pid=13357): stderr: | [0;m[38;5;43m20221213233101966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233101966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233101967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233101972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233101975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233101975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233101975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:03.709873 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13357): Process ended prematurely: osmo-stp_10.42.42.5(pid=13357) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13357)] [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:31:03.718722 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:31:03.744659 run osmo-hlr_10.42.42.2(pid=13354): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13354)] 23:31:03.792559 run osmo-hlr_10.42.42.2(pid=13354): stdout: | (launched: 2022-12-13_23:31:00.576098) 23:31:03.842362 run osmo-hlr_10.42.42.2(pid=13354): stderr: | [0;m[1;31m20221213233100752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233100752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233100752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233100753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233100753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233100753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233100765 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233100774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233100774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233100774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:03.911653 run osmo-msc_10.42.42.6(pid=13360): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13360)] 23:31:03.959243 run osmo-msc_10.42.42.6(pid=13360): stdout: | (launched: 2022-12-13_23:31:02.853558) 23:31:04.008732 run osmo-msc_10.42.42.6(pid=13360): stderr: | [0;m[38;5;43m20221213233103127 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233103127 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f747428cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233103128 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233103128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233103128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233103128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233103130 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233103130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233103130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233103130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:04.058311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13353): Terminating (SIGTERM) 23:31:04.097923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13356): Terminating (SIGTERM) 23:31:04.137376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13359): Terminating (SIGTERM) 23:31:04.177669 --- ParallelTerminationStrategy: PID 13353 died... 23:31:04.196877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13353): Terminated: ok {rc=0} 23:31:04.240785 --- ParallelTerminationStrategy: PID 13356 died... 23:31:04.259413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13356): Terminated: ok {rc=0} 23:31:04.302925 --- ParallelTerminationStrategy: PID 13359 died... 23:31:04.321385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13359): Terminated: ok {rc=0} 23:31:04.406740 bus /sierra_3: Setting Powered False 23:31:05.505955 bus /sierra_3: Setting Powered False 23:31:06.618699 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:31:07.873520 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:31:07.880490 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:31:07.914179 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:31:07.943781 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:31:07.994690 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:31:08.027488 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:31:08.054647 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:31:08.606055 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:31:08.654568 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:08.665793 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:31:08.733813 tst mo_mt_call.py: using LAC 36983 23:31:08.852661 tst mo_mt_call.py: using RAC 8 23:31:08.970568 tst mo_mt_call.py: using CellId 36983 23:31:09.089135 tst mo_mt_call.py: using BVCI 36984 23:31:09.197137 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:09.208117 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:09.218870 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:09.229630 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:09.240915 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:09.252351 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:31:09.371958 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:31:09.487256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:09.947779 run create_hlr_db(pid=13365): Launched 23:31:10.069270 bus /sierra_2: Setting Powered False 23:31:11.128606 run create_hlr_db(pid=13365): Terminated: ok {rc=0} 23:31:11.561288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13367): Launched 23:31:11.878087 run osmo-hlr_10.42.42.2(pid=13368): Launched 23:31:11.999152 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:12.542848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13370): Launched 23:31:12.858104 run osmo-stp_10.42.42.5(pid=13371): Launched 23:31:12.978421 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:13.548830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13373): Launched 23:31:13.865301 run osmo-msc_10.42.42.6(pid=13374): Launched 23:31:14.042022 run osmo-stp_10.42.42.5(pid=13371): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13371)] 23:31:14.175734 run osmo-stp_10.42.42.5(pid=13371): stdout: | (launched: 2022-12-13_23:31:12.800613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:14.310444 run osmo-stp_10.42.42.5(pid=13371): stderr: | [0;m[38;5;43m20221213233112992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233112992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233112993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233112993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233112993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233112994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233112994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:14.444473 run osmo-stp_10.42.42.5(pid=13371): stdout: | (launched: 2022-12-13_23:31:12.800613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:14.570675 run osmo-stp_10.42.42.5(pid=13371): stderr: | [0;m[38;5;43m20221213233112992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233112992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233112993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233112993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233112993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233112994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233112994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:14.722161 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13371): Process ended prematurely: osmo-stp_10.42.42.5(pid=13371) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13371)] [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:31:14.731615 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:31:14.759128 run osmo-hlr_10.42.42.2(pid=13368): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13368)] 23:31:14.809562 run osmo-hlr_10.42.42.2(pid=13368): stdout: | (launched: 2022-12-13_23:31:11.820785) 23:31:14.861988 run osmo-hlr_10.42.42.2(pid=13368): stderr: | [0;m[1;31m20221213233112020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233112020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233112020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233112020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233112020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233112020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233112033 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233112041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233112041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233112041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:14.934743 run osmo-msc_10.42.42.6(pid=13374): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13374)] 23:31:14.984343 run osmo-msc_10.42.42.6(pid=13374): stdout: | (launched: 2022-12-13_23:31:13.807618) 23:31:15.036169 run osmo-msc_10.42.42.6(pid=13374): stderr: | [0;m[38;5;43m20221213233114129 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233114129 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fce3a122c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233114130 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233114130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233114130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233114130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233114133 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233114133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233114133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233114133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:15.088772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13367): Terminating (SIGTERM) 23:31:15.130262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13370): Terminating (SIGTERM) 23:31:15.171950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13373): Terminating (SIGTERM) 23:31:15.213852 --- ParallelTerminationStrategy: PID 13367 died... 23:31:15.234171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13367): Terminated: ok {rc=0} 23:31:15.280312 --- ParallelTerminationStrategy: PID 13370 died... 23:31:15.300256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13370): Terminated: ok {rc=0} 23:31:15.346760 --- ParallelTerminationStrategy: PID 13373 died... 23:31:15.366617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13373): Terminated: ok {rc=0} 23:31:15.455031 bus /sierra_3: Setting Powered False 23:31:16.552745 bus /sierra_3: Setting Powered False 23:31:17.664228 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:31:18.812666 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:18.825116 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:31:18.895940 tst mo_mt_call_osmux.py: using LAC 36984 23:31:19.020578 tst mo_mt_call_osmux.py: using RAC 9 23:31:19.145304 tst mo_mt_call_osmux.py: using CellId 36984 23:31:19.269377 tst mo_mt_call_osmux.py: using BVCI 36985 23:31:19.386026 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:19.397487 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:19.408703 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:19.419942 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:19.431565 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:19.443108 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:31:19.562719 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:31:19.677983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:20.139408 run create_hlr_db(pid=13376): Launched 23:31:20.260606 bus /sierra_2: Setting Powered False 23:31:21.320629 run create_hlr_db(pid=13376): Terminated: ok {rc=0} 23:31:21.753486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13378): Launched 23:31:22.070281 run osmo-hlr_10.42.42.2(pid=13379): Launched 23:31:22.191051 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:22.740864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13381): Launched 23:31:23.057032 run osmo-stp_10.42.42.5(pid=13382): Launched 23:31:23.178217 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:23.750130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13384): Launched 23:31:24.067378 run osmo-msc_10.42.42.6(pid=13385): Launched 23:31:24.244310 run osmo-stp_10.42.42.5(pid=13382): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13382)] 23:31:24.378585 run osmo-stp_10.42.42.5(pid=13382): stdout: | (launched: 2022-12-13_23:31:22.999934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:24.513797 run osmo-stp_10.42.42.5(pid=13382): stderr: | [0;m[38;5;43m20221213233123191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233123191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233123191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233123192 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233123192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233123192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233123192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:24.648316 run osmo-stp_10.42.42.5(pid=13382): stdout: | (launched: 2022-12-13_23:31:22.999934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:24.775462 run osmo-stp_10.42.42.5(pid=13382): stderr: | [0;m[38;5;43m20221213233123191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233123191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233123191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233123192 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233123192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233123192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233123192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:24.927500 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13382): Process ended prematurely: osmo-stp_10.42.42.5(pid=13382) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13382)] [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:31:24.937145 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:31:24.964734 run osmo-hlr_10.42.42.2(pid=13379): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13379)] 23:31:25.015671 run osmo-hlr_10.42.42.2(pid=13379): stdout: | (launched: 2022-12-13_23:31:22.012749) 23:31:25.068246 run osmo-hlr_10.42.42.2(pid=13379): stderr: | [0;m[1;31m20221213233122211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233122211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233122211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233122211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233122211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233122211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233122224 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233122232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233122232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233122232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:25.140826 run osmo-msc_10.42.42.6(pid=13385): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13385)] 23:31:25.190704 run osmo-msc_10.42.42.6(pid=13385): stdout: | (launched: 2022-12-13_23:31:24.009799) 23:31:25.242567 run osmo-msc_10.42.42.6(pid=13385): stderr: | [0;m[38;5;43m20221213233124329 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233124329 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f77a72e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233124329 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233124329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233124329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233124330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233124332 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233124333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233124333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233124333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:25.295632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13378): Terminating (SIGTERM) 23:31:25.337512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13381): Terminating (SIGTERM) 23:31:25.379467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13384): Terminating (SIGTERM) 23:31:25.421761 --- ParallelTerminationStrategy: PID 13378 died... 23:31:25.441982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13378): Terminated: ok {rc=0} 23:31:25.488284 --- ParallelTerminationStrategy: PID 13381 died... 23:31:25.508192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13381): Terminated: ok {rc=0} 23:31:25.554354 --- ParallelTerminationStrategy: PID 13384 died... 23:31:25.574383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13384): Terminated: ok {rc=0} 23:31:25.661581 bus /sierra_3: Setting Powered False 23:31:26.759703 bus /sierra_3: Setting Powered False 23:31:27.871678 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:31:29.126790 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:31:29.135382 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:31:29.170291 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:31:29.197911 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:31:29.249320 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:31:29.283373 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:31:29.311276 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:31:29.860651 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:31:29.907928 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:29.918980 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:31:29.986611 tst mo_mt_call.py: using LAC 36985 23:31:30.103812 tst mo_mt_call.py: using RAC 10 23:31:30.218353 tst mo_mt_call.py: using CellId 36985 23:31:30.334547 tst mo_mt_call.py: using BVCI 36986 23:31:30.441722 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:30.452596 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:30.463375 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:30.474114 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:30.484916 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:30.495722 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:31:30.609336 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:31:30.728741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:31.251617 run create_hlr_db(pid=13390): Launched 23:31:31.407853 bus /sierra_2: Setting Powered False 23:31:32.470560 run create_hlr_db(pid=13390): Terminated: ok {rc=0} 23:31:32.897107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13392): Launched 23:31:33.193278 run osmo-hlr_10.42.42.2(pid=13393): Launched 23:31:33.305995 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:33.831874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13395): Launched 23:31:34.126971 run osmo-stp_10.42.42.5(pid=13396): Launched 23:31:34.239616 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:34.777690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13398): Launched 23:31:35.073916 run osmo-msc_10.42.42.6(pid=13399): Launched 23:31:35.239149 run osmo-stp_10.42.42.5(pid=13396): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13396)] 23:31:35.364581 run osmo-stp_10.42.42.5(pid=13396): stdout: | (launched: 2022-12-13_23:31:34.072284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:35.490795 run osmo-stp_10.42.42.5(pid=13396): stderr: | [0;m[38;5;43m20221213233134242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233134242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233134242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233134242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233134243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233134243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233134243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:35.614425 run osmo-stp_10.42.42.5(pid=13396): stdout: | (launched: 2022-12-13_23:31:34.072284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:35.733345 run osmo-stp_10.42.42.5(pid=13396): stderr: | [0;m[38;5;43m20221213233134242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233134242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233134242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233134242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233134243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233134243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233134243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:35.875011 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13396): Process ended prematurely: osmo-stp_10.42.42.5(pid=13396) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13396)] [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:31:35.883726 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:31:35.909683 run osmo-hlr_10.42.42.2(pid=13393): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13393)] 23:31:35.957468 run osmo-hlr_10.42.42.2(pid=13393): stdout: | (launched: 2022-12-13_23:31:33.139238) 23:31:36.006360 run osmo-hlr_10.42.42.2(pid=13393): stderr: | [0;m[1;31m20221213233133314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233133314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233133314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233133314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233133314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233133314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233133326 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233133336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233133336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233133336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:36.074655 run osmo-msc_10.42.42.6(pid=13399): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13399)] 23:31:36.122499 run osmo-msc_10.42.42.6(pid=13399): stdout: | (launched: 2022-12-13_23:31:35.019886) 23:31:36.172221 run osmo-msc_10.42.42.6(pid=13399): stderr: | [0;m[38;5;43m20221213233135290 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233135290 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe32e82cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233135290 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233135290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233135290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233135291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233135292 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233135293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233135293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233135293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:36.221344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13392): Terminating (SIGTERM) 23:31:36.260339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13395): Terminating (SIGTERM) 23:31:36.299312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13398): Terminating (SIGTERM) 23:31:36.338664 --- ParallelTerminationStrategy: PID 13392 died... 23:31:36.357544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13392): Terminated: ok {rc=0} 23:31:36.401127 --- ParallelTerminationStrategy: PID 13395 died... 23:31:36.419575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13395): Terminated: ok {rc=0} 23:31:36.463193 --- ParallelTerminationStrategy: PID 13398 died... 23:31:36.481714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13398): Terminated: ok {rc=0} 23:31:36.567232 bus /sierra_3: Setting Powered False 23:31:37.667016 bus /sierra_3: Setting Powered False 23:31:38.782080 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:31:39.927029 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:39.938728 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:31:40.007694 tst mo_mt_call_osmux.py: using LAC 36986 23:31:40.126281 tst mo_mt_call_osmux.py: using RAC 11 23:31:40.243546 tst mo_mt_call_osmux.py: using CellId 36986 23:31:40.362264 tst mo_mt_call_osmux.py: using BVCI 36987 23:31:40.471699 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:40.482710 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:40.493530 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:40.504242 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:40.515063 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:40.526045 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:31:40.645485 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:31:40.760548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:41.219443 run create_hlr_db(pid=13401): Launched 23:31:41.340148 bus /sierra_2: Setting Powered False 23:31:42.400782 run create_hlr_db(pid=13401): Terminated: ok {rc=0} 23:31:42.814421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13403): Launched 23:31:43.109712 run osmo-hlr_10.42.42.2(pid=13404): Launched 23:31:43.222384 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:43.746701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13406): Launched 23:31:44.042464 run osmo-stp_10.42.42.5(pid=13407): Launched 23:31:44.155052 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:44.691146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13409): Launched 23:31:44.986251 run osmo-msc_10.42.42.6(pid=13410): Launched 23:31:45.150921 run osmo-stp_10.42.42.5(pid=13407): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13407)] 23:31:45.275204 run osmo-stp_10.42.42.5(pid=13407): stdout: | (launched: 2022-12-13_23:31:43.988842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:45.400473 run osmo-stp_10.42.42.5(pid=13407): stderr: | [0;m[38;5;43m20221213233144159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233144159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233144160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233144160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233144161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233144161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233144161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:45.524102 run osmo-stp_10.42.42.5(pid=13407): stdout: | (launched: 2022-12-13_23:31:43.988842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:45.642019 run osmo-stp_10.42.42.5(pid=13407): stderr: | [0;m[38;5;43m20221213233144159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233144159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233144160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233144160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233144161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233144161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233144161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:45.782960 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13407): Process ended prematurely: osmo-stp_10.42.42.5(pid=13407) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13407)] [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:31:45.791924 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 23:31:45.818077 run osmo-hlr_10.42.42.2(pid=13404): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13404)] 23:31:45.893524 run osmo-hlr_10.42.42.2(pid=13404): stdout: | (launched: 2022-12-13_23:31:43.055951) 23:31:45.967124 run osmo-hlr_10.42.42.2(pid=13404): stderr: | [0;m[1;31m20221213233143233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233143233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233143233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233143234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233143234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233143234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233143246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233143254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233143254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233143254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:46.046084 run osmo-msc_10.42.42.6(pid=13410): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13410)] 23:31:46.094522 run osmo-msc_10.42.42.6(pid=13410): stdout: | (launched: 2022-12-13_23:31:44.932573) 23:31:46.145315 run osmo-msc_10.42.42.6(pid=13410): stderr: | [0;m[38;5;43m20221213233145204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233145204 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe87bc19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233145204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233145204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233145204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233145205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233145207 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233145207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233145207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233145207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:46.197649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13403): Terminating (SIGTERM) 23:31:46.240169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13406): Terminating (SIGTERM) 23:31:46.283310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13409): Terminating (SIGTERM) 23:31:46.325309 --- ParallelTerminationStrategy: PID 13403 died... 23:31:46.345622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13403): Terminated: ok {rc=0} 23:31:46.391585 --- ParallelTerminationStrategy: PID 13406 died... 23:31:46.411629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13406): Terminated: ok {rc=0} 23:31:46.457539 --- ParallelTerminationStrategy: PID 13409 died... 23:31:46.477827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13409): Terminated: ok {rc=0} 23:31:46.563981 bus /sierra_3: Setting Powered False 23:31:47.659718 bus /sierra_3: Setting Powered False 23:31:48.775046 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:31:50.025071 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:31:50.031589 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:31:50.064047 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:31:50.090651 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:31:50.141001 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:31:50.173743 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:31:50.200189 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:31:50.751039 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:31:50.798874 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:50.810082 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:31:50.881511 tst mo_mt_call.py: using LAC 36987 23:31:50.998121 tst mo_mt_call.py: using RAC 12 23:31:51.113714 tst mo_mt_call.py: using CellId 36987 23:31:51.238249 tst mo_mt_call.py: using BVCI 36988 23:31:51.353580 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:51.365345 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:51.376497 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:51.388034 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:51.399932 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:51.411519 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:31:51.527066 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:31:51.646499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:52.140229 run create_hlr_db(pid=13415): Launched 23:31:52.261945 bus /sierra_2: Setting Powered False 23:31:53.325099 run create_hlr_db(pid=13415): Terminated: ok {rc=0} 23:31:53.749594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13417): Launched 23:31:54.047473 run osmo-hlr_10.42.42.2(pid=13418): Launched 23:31:54.161906 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:54.687576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13420): Launched 23:31:54.983895 run osmo-stp_10.42.42.5(pid=13421): Launched 23:31:55.096742 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:55.632090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13423): Launched 23:31:55.927998 run osmo-msc_10.42.42.6(pid=13424): Launched 23:31:56.092902 run osmo-stp_10.42.42.5(pid=13421): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13421)] 23:31:56.217864 run osmo-stp_10.42.42.5(pid=13421): stdout: | (launched: 2022-12-13_23:31:54.929939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:56.345067 run osmo-stp_10.42.42.5(pid=13421): stderr: | [0;m[38;5;43m20221213233155099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233155099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233155100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233155100 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233155101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233155101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233155101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:56.468281 run osmo-stp_10.42.42.5(pid=13421): stdout: | (launched: 2022-12-13_23:31:54.929939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:56.586832 run osmo-stp_10.42.42.5(pid=13421): stderr: | [0;m[38;5;43m20221213233155099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233155099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233155100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233155100 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233155101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233155101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233155101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:56.727709 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13421): Process ended prematurely: osmo-stp_10.42.42.5(pid=13421) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13421)] [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:31:56.736574 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:31:56.762824 run osmo-hlr_10.42.42.2(pid=13418): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13418)] 23:31:56.810499 run osmo-hlr_10.42.42.2(pid=13418): stdout: | (launched: 2022-12-13_23:31:53.993476) 23:31:56.859903 run osmo-hlr_10.42.42.2(pid=13418): stderr: | [0;m[1;31m20221213233154170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233154170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233154170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233154170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233154170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233154170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233154182 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233154191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233154191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233154191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:56.928381 run osmo-msc_10.42.42.6(pid=13424): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13424)] 23:31:56.975950 run osmo-msc_10.42.42.6(pid=13424): stdout: | (launched: 2022-12-13_23:31:55.874000) 23:31:57.025058 run osmo-msc_10.42.42.6(pid=13424): stderr: | [0;m[38;5;43m20221213233156146 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233156146 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7426c53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233156146 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233156146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233156147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233156147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233156148 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233156149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233156149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233156149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:57.074705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13417): Terminating (SIGTERM) 23:31:57.114023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13420): Terminating (SIGTERM) 23:31:57.153326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13423): Terminating (SIGTERM) 23:31:57.193401 --- ParallelTerminationStrategy: PID 13417 died... 23:31:57.212568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13417): Terminated: ok {rc=0} 23:31:57.256096 --- ParallelTerminationStrategy: PID 13420 died... 23:31:57.274485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13420): Terminated: ok {rc=0} 23:31:57.318116 --- ParallelTerminationStrategy: PID 13423 died... 23:31:57.336537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13423): Terminated: ok {rc=0} 23:31:57.419861 bus /sierra_3: Setting Powered False 23:31:58.516232 bus /sierra_3: Setting Powered False 23:31:59.631714 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:32:00.779824 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:32:00.791885 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:32:00.880200 tst mo_mt_call_osmux.py: using LAC 36988 23:32:01.001380 tst mo_mt_call_osmux.py: using RAC 13 23:32:01.138759 tst mo_mt_call_osmux.py: using CellId 36988 23:32:01.267569 tst mo_mt_call_osmux.py: using BVCI 36989 23:32:01.382295 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:32:01.394247 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:32:01.405740 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:32:01.417216 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:32:01.429550 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:32:01.441837 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:32:01.560409 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:32:01.678186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:02.164929 run create_hlr_db(pid=13426): Launched 23:32:02.319680 bus /sierra_2: Setting Powered False 23:32:03.380174 run create_hlr_db(pid=13426): Terminated: ok {rc=0} 23:32:03.794991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13428): Launched 23:32:04.092288 run osmo-hlr_10.42.42.2(pid=13429): Launched 23:32:04.205173 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:04.728794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13431): Launched 23:32:05.025311 run osmo-stp_10.42.42.5(pid=13432): Launched 23:32:05.139642 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:05.675418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13434): Launched 23:32:05.971632 run osmo-msc_10.42.42.6(pid=13435): Launched 23:32:06.137541 run osmo-stp_10.42.42.5(pid=13432): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13432)] 23:32:06.262661 run osmo-stp_10.42.42.5(pid=13432): stdout: | (launched: 2022-12-13_23:32:04.971315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:06.389134 run osmo-stp_10.42.42.5(pid=13432): stderr: | [0;m[38;5;43m20221213233205143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233205143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233205143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233205144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233205144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233205144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233205145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:06.512902 run osmo-stp_10.42.42.5(pid=13432): stdout: | (launched: 2022-12-13_23:32:04.971315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:06.631602 run osmo-stp_10.42.42.5(pid=13432): stderr: | [0;m[38;5;43m20221213233205143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233205143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233205143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233205144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233205144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233205144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233205145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:06.773327 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13432): Process ended prematurely: osmo-stp_10.42.42.5(pid=13432) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13432)] [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:32:06.782267 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:32:06.808517 run osmo-hlr_10.42.42.2(pid=13429): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13429)] 23:32:06.857071 run osmo-hlr_10.42.42.2(pid=13429): stdout: | (launched: 2022-12-13_23:32:04.038238) 23:32:06.906531 run osmo-hlr_10.42.42.2(pid=13429): stderr: | [0;m[1;31m20221213233204214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233204214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233204214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233204214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233204214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233204214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233204226 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233204235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233204235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233204235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:06.975713 run osmo-msc_10.42.42.6(pid=13435): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13435)] 23:32:07.023270 run osmo-msc_10.42.42.6(pid=13435): stdout: | (launched: 2022-12-13_23:32:05.917632) 23:32:07.073236 run osmo-msc_10.42.42.6(pid=13435): stderr: | [0;m[38;5;43m20221213233206187 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233206187 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2f87783c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233206187 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233206187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233206188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233206188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233206189 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233206190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233206190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233206190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:07.123331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13428): Terminating (SIGTERM) 23:32:07.162843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13431): Terminating (SIGTERM) 23:32:07.202657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13434): Terminating (SIGTERM) 23:32:07.242577 --- ParallelTerminationStrategy: PID 13428 died... 23:32:07.261784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13428): Terminated: ok {rc=0} 23:32:07.305795 --- ParallelTerminationStrategy: PID 13431 died... 23:32:07.324439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13431): Terminated: ok {rc=0} 23:32:07.368046 --- ParallelTerminationStrategy: PID 13434 died... 23:32:07.386904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13434): Terminated: ok {rc=0} 23:32:07.469883 bus /sierra_3: Setting Powered False 23:32:08.565679 bus /sierra_3: Setting Powered False 23:32:09.679313 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:32:10.950220 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:32:10.958550 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:32:10.992775 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:32:11.020721 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:32:11.075866 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:32:11.110082 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:32:11.137108 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:32:11.687758 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:32:11.736293 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:11.747607 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:32:11.816163 tst mo_mt_call.py: using LAC 36989 23:32:11.932667 tst mo_mt_call.py: using RAC 14 23:32:12.048285 tst mo_mt_call.py: using CellId 36989 23:32:12.172165 tst mo_mt_call.py: using BVCI 36990 23:32:12.287506 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:12.299339 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:12.310905 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:12.322436 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:12.334479 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:12.346170 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:32:12.463787 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:32:12.582314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:13.074488 run create_hlr_db(pid=13440): Launched 23:32:13.195335 bus /sierra_2: Setting Powered False 23:32:14.258109 run create_hlr_db(pid=13440): Terminated: ok {rc=0} 23:32:14.684639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13442): Launched 23:32:14.981838 run osmo-hlr_10.42.42.2(pid=13443): Launched 23:32:15.095033 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:15.620759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13445): Launched 23:32:15.930676 run osmo-stp_10.42.42.5(pid=13446): Launched 23:32:16.203479 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:16.978262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13448): Launched 23:32:17.300318 run osmo-msc_10.42.42.6(pid=13449): Launched 23:32:17.499772 run osmo-stp_10.42.42.5(pid=13446): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13446)] 23:32:17.626339 run osmo-stp_10.42.42.5(pid=13446): stdout: | (launched: 2022-12-13_23:32:15.862560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:17.753208 run osmo-stp_10.42.42.5(pid=13446): stderr: | [0;m[38;5;43m20221213233216094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233216094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233216094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233216095 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233216101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233216101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233216101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:17.877595 run osmo-stp_10.42.42.5(pid=13446): stdout: | (launched: 2022-12-13_23:32:15.862560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:17.996117 run osmo-stp_10.42.42.5(pid=13446): stderr: | [0;m[38;5;43m20221213233216094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233216094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233216094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233216095 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233216101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233216101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233216101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:18.137987 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13446): Process ended prematurely: osmo-stp_10.42.42.5(pid=13446) [trial-2396↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13446)] [trial-2396↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:32:18.146865 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:32:18.173283 run osmo-hlr_10.42.42.2(pid=13443): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13443)] 23:32:18.221307 run osmo-hlr_10.42.42.2(pid=13443): stdout: | (launched: 2022-12-13_23:32:14.927750) 23:32:18.270681 run osmo-hlr_10.42.42.2(pid=13443): stderr: | [0;m[1;31m20221213233215104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233215104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233215104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233215104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233215104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233215104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233215117 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233215127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233215127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233215127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:18.339306 run osmo-msc_10.42.42.6(pid=13449): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13449)] 23:32:18.386692 run osmo-msc_10.42.42.6(pid=13449): stdout: | (launched: 2022-12-13_23:32:17.229113) 23:32:18.435974 run osmo-msc_10.42.42.6(pid=13449): stderr: | [0;m[38;5;43m20221213233217556 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233217556 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1c7c4cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233217556 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233217556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233217556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233217557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233217558 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233217559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233217559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233217559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:18.486001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13442): Terminating (SIGTERM) 23:32:18.525311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13445): Terminating (SIGTERM) 23:32:18.565611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13448): Terminating (SIGTERM) 23:32:18.605690 --- ParallelTerminationStrategy: PID 13442 died... 23:32:18.624778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13442): Terminated: ok {rc=0} 23:32:18.669087 --- ParallelTerminationStrategy: PID 13445 died... 23:32:18.687674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13445): Terminated: ok {rc=0} 23:32:18.731542 --- ParallelTerminationStrategy: PID 13448 died... 23:32:18.750395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13448): Terminated: ok {rc=0} 23:32:18.835810 bus /sierra_3: Setting Powered False 23:32:19.936026 bus /sierra_3: Setting Powered False 23:32:21.047867 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:32:22.195704 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:22.208190 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:32:22.281181 tst mo_mt_call_osmux.py: using LAC 36990 23:32:22.406319 tst mo_mt_call_osmux.py: using RAC 15 23:32:22.532015 tst mo_mt_call_osmux.py: using CellId 36990 23:32:22.650486 tst mo_mt_call_osmux.py: using BVCI 36991 23:32:22.760157 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:22.771516 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:22.782619 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:22.793686 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:22.804764 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:22.816011 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:32:22.930565 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:32:23.049669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:23.541231 run create_hlr_db(pid=13451): Launched 23:32:23.663978 bus /sierra_2: Setting Powered False 23:32:24.724168 run create_hlr_db(pid=13451): Terminated: ok {rc=0} 23:32:25.141315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13453): Launched 23:32:25.439078 run osmo-hlr_10.42.42.2(pid=13454): Launched 23:32:25.553285 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:26.089554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13456): Launched 23:32:26.385085 run osmo-stp_10.42.42.5(pid=13457): Launched 23:32:26.498374 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:27.034029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13459): Launched 23:32:27.329724 run osmo-msc_10.42.42.6(pid=13460): Launched 23:32:27.495075 run osmo-stp_10.42.42.5(pid=13457): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13457)] 23:32:27.619997 run osmo-stp_10.42.42.5(pid=13457): stdout: | (launched: 2022-12-13_23:32:26.331096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:27.745575 run osmo-stp_10.42.42.5(pid=13457): stderr: | [0;m[38;5;43m20221213233226501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233226501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233226501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233226502 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233226502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233226502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233226502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:27.868839 run osmo-stp_10.42.42.5(pid=13457): stdout: | (launched: 2022-12-13_23:32:26.331096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:27.986650 run osmo-stp_10.42.42.5(pid=13457): stderr: | [0;m[38;5;43m20221213233226501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233226501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233226501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233226502 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233226502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233226502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233226502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:28.127470 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13457): Process ended prematurely: osmo-stp_10.42.42.5(pid=13457) [trial-2396↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13457)] [trial-2396↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:32:28.136195 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:32:28.162593 run osmo-hlr_10.42.42.2(pid=13454): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13454)] 23:32:28.210174 run osmo-hlr_10.42.42.2(pid=13454): stdout: | (launched: 2022-12-13_23:32:25.385154) 23:32:28.258889 run osmo-hlr_10.42.42.2(pid=13454): stderr: | [0;m[1;31m20221213233225562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233225562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233225562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233225562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233225562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233225562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233225573 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233225582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233225583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233225583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:28.327228 run osmo-msc_10.42.42.6(pid=13460): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13460)] 23:32:28.374231 run osmo-msc_10.42.42.6(pid=13460): stdout: | (launched: 2022-12-13_23:32:27.276040) 23:32:28.422985 run osmo-msc_10.42.42.6(pid=13460): stderr: | [0;m[38;5;43m20221213233227547 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233227547 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0bd02c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233227547 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233227547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233227548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233227548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233227550 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233227550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233227550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233227550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:28.471980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13453): Terminating (SIGTERM) 23:32:28.510980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13456): Terminating (SIGTERM) 23:32:28.550803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13459): Terminating (SIGTERM) 23:32:28.590190 --- ParallelTerminationStrategy: PID 13453 died... 23:32:28.609105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13453): Terminated: ok {rc=0} 23:32:28.652417 --- ParallelTerminationStrategy: PID 13456 died... 23:32:28.670811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13456): Terminated: ok {rc=0} 23:32:28.713821 --- ParallelTerminationStrategy: PID 13459 died... 23:32:28.732048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13459): Terminated: ok {rc=0} 23:32:28.816141 bus /sierra_3: Setting Powered False 23:32:29.912177 bus /sierra_3: Setting Powered False 23:32:31.025114 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:32:32.293427 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:32:32.299551 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:32:32.334776 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:32:32.362467 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:32:32.415339 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:32:32.449422 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:32:32.477163 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:32:33.027832 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:32:33.077354 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:33.088097 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:32:33.156045 tst mo_mt_call.py: using LAC 36991 23:32:33.271454 tst mo_mt_call.py: using RAC 16 23:32:33.386345 tst mo_mt_call.py: using CellId 36991 23:32:33.501721 tst mo_mt_call.py: using BVCI 36992 23:32:33.609158 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:33.619974 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:33.630629 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:33.641229 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:33.651889 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:33.662579 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:32:33.781406 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:32:33.897890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:34.357078 run create_hlr_db(pid=13465): Launched 23:32:34.479110 bus /sierra_2: Setting Powered False 23:32:35.538710 run create_hlr_db(pid=13465): Terminated: ok {rc=0} 23:32:35.974568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13467): Launched 23:32:36.292032 run osmo-hlr_10.42.42.2(pid=13468): Launched 23:32:36.413613 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:36.961449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13470): Launched 23:32:37.278235 run osmo-stp_10.42.42.5(pid=13471): Launched 23:32:37.399928 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:37.982796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13473): Launched 23:32:38.300554 run osmo-msc_10.42.42.6(pid=13474): Launched 23:32:38.478769 run osmo-stp_10.42.42.5(pid=13471): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13471)] 23:32:38.613467 run osmo-stp_10.42.42.5(pid=13471): stdout: | (launched: 2022-12-13_23:32:37.220753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:38.749255 run osmo-stp_10.42.42.5(pid=13471): stderr: | [0;m[38;5;43m20221213233237411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233237411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233237412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233237412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233237412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233237412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233237413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:38.884218 run osmo-stp_10.42.42.5(pid=13471): stdout: | (launched: 2022-12-13_23:32:37.220753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:39.012075 run osmo-stp_10.42.42.5(pid=13471): stderr: | [0;m[38;5;43m20221213233237411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233237411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233237412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233237412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233237412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233237412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233237413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:39.164220 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13471): Process ended prematurely: osmo-stp_10.42.42.5(pid=13471) [trial-2396↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13471)] [trial-2396↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:32:39.174175 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:32:39.201962 run osmo-hlr_10.42.42.2(pid=13468): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13468)] 23:32:39.253156 run osmo-hlr_10.42.42.2(pid=13468): stdout: | (launched: 2022-12-13_23:32:36.234745) 23:32:39.305336 run osmo-hlr_10.42.42.2(pid=13468): stderr: | [0;m[1;31m20221213233236433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233236433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233236433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233236433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233236433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233236433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233236447 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233236455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233236455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233236455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:39.377999 run osmo-msc_10.42.42.6(pid=13474): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13474)] 23:32:39.428147 run osmo-msc_10.42.42.6(pid=13474): stdout: | (launched: 2022-12-13_23:32:38.243073) 23:32:39.479926 run osmo-msc_10.42.42.6(pid=13474): stderr: | [0;m[38;5;43m20221213233238563 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233238563 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff83323fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233238563 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233238564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233238564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233238564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233238566 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233238566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233238566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233238566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:39.532113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13467): Terminating (SIGTERM) 23:32:39.574080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13470): Terminating (SIGTERM) 23:32:39.615982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13473): Terminating (SIGTERM) 23:32:39.658842 --- ParallelTerminationStrategy: PID 13467 died... 23:32:39.679297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13467): Terminated: ok {rc=0} 23:32:39.725887 --- ParallelTerminationStrategy: PID 13470 died... 23:32:39.745749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13470): Terminated: ok {rc=0} 23:32:39.791968 --- ParallelTerminationStrategy: PID 13473 died... 23:32:39.811896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13473): Terminated: ok {rc=0} 23:32:39.900658 bus /sierra_3: Setting Powered False 23:32:40.996089 bus /sierra_3: Setting Powered False 23:32:42.111510 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:32:43.257141 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:43.268637 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:32:43.338075 tst mo_mt_call_osmux.py: using LAC 36992 23:32:43.457062 tst mo_mt_call_osmux.py: using RAC 17 23:32:43.573920 tst mo_mt_call_osmux.py: using CellId 36992 23:32:43.693043 tst mo_mt_call_osmux.py: using BVCI 36993 23:32:43.810106 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:43.821834 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:43.833137 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:43.844349 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:43.856024 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:43.868043 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:32:43.984282 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:32:44.104300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:44.597162 run create_hlr_db(pid=13476): Launched 23:32:44.717783 bus /sierra_2: Setting Powered False 23:32:45.780808 run create_hlr_db(pid=13476): Terminated: ok {rc=0} 23:32:46.263212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13478): Launched 23:32:46.599316 run osmo-hlr_10.42.42.2(pid=13479): Launched 23:32:46.899115 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:47.608834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13481): Launched 23:32:47.927086 run osmo-stp_10.42.42.5(pid=13482): Launched 23:32:48.048626 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:48.622447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13484): Launched 23:32:48.941948 run osmo-msc_10.42.42.6(pid=13485): Launched 23:32:49.119543 run osmo-stp_10.42.42.5(pid=13482): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13482)] 23:32:49.254144 run osmo-stp_10.42.42.5(pid=13482): stdout: | (launched: 2022-12-13_23:32:47.869842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:49.389629 run osmo-stp_10.42.42.5(pid=13482): stderr: | [0;m[38;5;43m20221213233248059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233248059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233248059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233248060 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233248060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233248060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233248060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:49.524015 run osmo-stp_10.42.42.5(pid=13482): stdout: | (launched: 2022-12-13_23:32:47.869842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:49.651645 run osmo-stp_10.42.42.5(pid=13482): stderr: | [0;m[38;5;43m20221213233248059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233248059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233248059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233248060 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233248060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233248060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233248060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:49.803988 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13482): Process ended prematurely: osmo-stp_10.42.42.5(pid=13482) [trial-2396↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13482)] [trial-2396↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:32:49.813630 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 23:32:49.841564 run osmo-hlr_10.42.42.2(pid=13479): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13479)] 23:32:49.893442 run osmo-hlr_10.42.42.2(pid=13479): stdout: | (launched: 2022-12-13_23:32:46.532535) 23:32:49.945947 run osmo-hlr_10.42.42.2(pid=13479): stderr: | [0;m[1;31m20221213233246763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233246763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233246763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233246763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233246763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233246764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233246779 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233246796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233246796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233246796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:50.018461 run osmo-msc_10.42.42.6(pid=13485): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13485)] 23:32:50.068336 run osmo-msc_10.42.42.6(pid=13485): stdout: | (launched: 2022-12-13_23:32:48.883190) 23:32:50.120542 run osmo-msc_10.42.42.6(pid=13485): stderr: | [0;m[38;5;43m20221213233249206 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233249206 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5c40f12c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233249206 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233249206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233249206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233249207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233249208 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233249209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233249209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233249209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:50.173539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13478): Terminating (SIGTERM) 23:32:50.215175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13481): Terminating (SIGTERM) 23:32:50.257424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13484): Terminating (SIGTERM) 23:32:50.299506 --- ParallelTerminationStrategy: PID 13478 died... 23:32:50.319904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13478): Terminated: ok {rc=0} 23:32:50.366487 --- ParallelTerminationStrategy: PID 13481 died... 23:32:50.386136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13481): Terminated: ok {rc=0} 23:32:50.431939 --- ParallelTerminationStrategy: PID 13484 died... 23:32:50.451578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13484): Terminated: ok {rc=0} 23:32:50.539281 bus /sierra_3: Setting Powered False 23:32:51.636668 bus /sierra_3: Setting Powered False 23:32:52.753450 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 23:32:54.004062 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:32:54.008849 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 23:32:54.041215 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 23:32:54.067486 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 23:32:54.119257 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 23:32:54.153277 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 23:32:54.179368 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 23:32:54.726659 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 23:32:54.775050 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:54.785948 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 23:32:54.835825 tst mo_mt_call.py: using LAC 36993 23:32:54.953951 tst mo_mt_call.py: using RAC 18 23:32:55.081201 tst mo_mt_call.py: using CellId 36993 23:32:55.207999 tst mo_mt_call.py: using BVCI 36994 23:32:55.325437 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:55.337025 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:55.348584 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:55.359904 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:55.371578 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:55.383734 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 23:32:55.499353 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 23:32:55.613428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:56.072418 run create_hlr_db(pid=13493): Launched 23:32:56.194513 bus /sierra_2: Setting Powered False 23:32:57.254046 run create_hlr_db(pid=13493): Terminated: ok {rc=0} 23:32:57.669129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13495): Launched 23:32:57.964631 run osmo-hlr_10.42.42.2(pid=13496): Launched 23:32:58.077521 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:58.604423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13498): Launched 23:32:58.901155 run osmo-stp_10.42.42.5(pid=13499): Launched 23:32:59.013443 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:59.550441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13501): Launched 23:32:59.846443 run osmo-msc_10.42.42.6(pid=13502): Launched 23:33:00.011439 run osmo-stp_10.42.42.5(pid=13499): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13499)] 23:33:00.137146 run osmo-stp_10.42.42.5(pid=13499): stdout: | (launched: 2022-12-13_23:32:58.847061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:00.262447 run osmo-stp_10.42.42.5(pid=13499): stderr: | [0;m[38;5;43m20221213233259016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233259016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233259017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233259017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233259019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233259019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233259020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:00.386189 run osmo-stp_10.42.42.5(pid=13499): stdout: | (launched: 2022-12-13_23:32:58.847061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:00.504349 run osmo-stp_10.42.42.5(pid=13499): stderr: | [0;m[38;5;43m20221213233259016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233259016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233259017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233259017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233259019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233259019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233259020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:00.645761 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13499): Process ended prematurely: osmo-stp_10.42.42.5(pid=13499) [trial-2396↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13499)] [trial-2396↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 23:33:00.654404 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 23:33:00.680238 run osmo-hlr_10.42.42.2(pid=13496): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13496)] 23:33:00.727893 run osmo-hlr_10.42.42.2(pid=13496): stdout: | (launched: 2022-12-13_23:32:57.911014) 23:33:00.777779 run osmo-hlr_10.42.42.2(pid=13496): stderr: | [0;m[1;31m20221213233258086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233258086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233258086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233258086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233258086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233258086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233258099 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233258107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233258108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233258108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:00.866214 run osmo-msc_10.42.42.6(pid=13502): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13502)] 23:33:00.925335 run osmo-msc_10.42.42.6(pid=13502): stdout: | (launched: 2022-12-13_23:32:59.792570) 23:33:00.979626 run osmo-msc_10.42.42.6(pid=13502): stderr: | [0;m[38;5;43m20221213233300062 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233300063 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa6607c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233300063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233300063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233300063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233300063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233300065 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233300065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233300066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233300066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:01.033462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13495): Terminating (SIGTERM) 23:33:01.081546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13498): Terminating (SIGTERM) 23:33:01.126475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13501): Terminating (SIGTERM) 23:33:01.174110 --- ParallelTerminationStrategy: PID 13495 died... 23:33:01.194777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13495): Terminated: ok {rc=0} 23:33:01.243975 --- ParallelTerminationStrategy: PID 13498 died... 23:33:01.264471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13498): Terminated: ok {rc=0} 23:33:01.313063 --- ParallelTerminationStrategy: PID 13501 died... 23:33:01.333661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13501): Terminated: ok {rc=0} 23:33:01.432212 bus /sierra_3: Setting Powered False 23:33:02.546461 bus /sierra_3: Setting Powered False 23:33:03.662634 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 23:33:04.812051 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:33:04.824074 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 23:33:04.876741 tst mo_mt_call_osmux.py: using LAC 36994 23:33:05.001973 tst mo_mt_call_osmux.py: using RAC 19 23:33:05.128940 tst mo_mt_call_osmux.py: using CellId 36994 23:33:05.247845 tst mo_mt_call_osmux.py: using BVCI 36995 23:33:05.356828 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:33:05.368092 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:33:05.379372 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:33:05.390399 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:33:05.401491 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:33:05.412536 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 23:33:05.531842 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 23:33:05.647435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:06.110164 run create_hlr_db(pid=13505): Launched 23:33:06.230678 bus /sierra_2: Setting Powered False 23:33:07.290228 run create_hlr_db(pid=13505): Terminated: ok {rc=0} 23:33:07.724566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13507): Launched 23:33:08.043416 run osmo-hlr_10.42.42.2(pid=13508): Launched 23:33:08.165324 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:08.713642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13510): Launched 23:33:09.030103 run osmo-stp_10.42.42.5(pid=13511): Launched 23:33:09.150720 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:09.723162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13513): Launched 23:33:10.041733 run osmo-msc_10.42.42.6(pid=13514): Launched 23:33:10.219206 run osmo-stp_10.42.42.5(pid=13511): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13511)] 23:33:10.353788 run osmo-stp_10.42.42.5(pid=13511): stdout: | (launched: 2022-12-13_23:33:08.972935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:10.488761 run osmo-stp_10.42.42.5(pid=13511): stderr: | [0;m[38;5;43m20221213233309166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233309166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233309166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233309167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233309167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233309167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233309167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:10.622632 run osmo-stp_10.42.42.5(pid=13511): stdout: | (launched: 2022-12-13_23:33:08.972935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:10.749188 run osmo-stp_10.42.42.5(pid=13511): stderr: | [0;m[38;5;43m20221213233309166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233309166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233309166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233309167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233309167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233309167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233309167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:10.901593 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13511): Process ended prematurely: osmo-stp_10.42.42.5(pid=13511) [trial-2396↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13511)] [trial-2396↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 23:33:10.910874 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:33:10.938395 run osmo-hlr_10.42.42.2(pid=13508): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13508)] 23:33:10.988506 run osmo-hlr_10.42.42.2(pid=13508): stdout: | (launched: 2022-12-13_23:33:07.986033) 23:33:11.040077 run osmo-hlr_10.42.42.2(pid=13508): stderr: | [0;m[1;31m20221213233308185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233308185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233308185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233308185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233308185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233308185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233308197 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233308205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233308206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233308206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:11.111790 run osmo-msc_10.42.42.6(pid=13514): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13514)] 23:33:11.161295 run osmo-msc_10.42.42.6(pid=13514): stdout: | (launched: 2022-12-13_23:33:09.984324) 23:33:11.212493 run osmo-msc_10.42.42.6(pid=13514): stderr: | [0;m[38;5;43m20221213233310304 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233310304 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba1b02ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233310304 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233310304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233310304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233310305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233310306 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233310307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233310307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233310307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:11.264097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13507): Terminating (SIGTERM) 23:33:11.305502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13510): Terminating (SIGTERM) 23:33:11.346695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13513): Terminating (SIGTERM) 23:33:11.388389 --- ParallelTerminationStrategy: PID 13507 died... 23:33:11.408543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13507): Terminated: ok {rc=0} 23:33:11.454997 --- ParallelTerminationStrategy: PID 13510 died... 23:33:11.474721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13510): Terminated: ok {rc=0} 23:33:11.520345 --- ParallelTerminationStrategy: PID 13513 died... 23:33:11.539991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13513): Terminated: ok {rc=0} 23:33:11.627143 bus /sierra_3: Setting Powered False 23:33:12.724128 bus /sierra_3: Setting Powered False 23:33:13.839695 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:33:15.090222 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:33:15.096637 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:33:15.130581 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 23:33:15.158770 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 23:33:15.210817 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:33:15.244262 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 23:33:15.272236 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 23:33:15.826701 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 23:33:15.888535 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:15.900924 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:33:15.959645 tst mo_mt_call.py: using LAC 36995 23:33:16.091269 tst mo_mt_call.py: using RAC 20 23:33:16.247665 tst mo_mt_call.py: using CellId 36995 23:33:16.369548 tst mo_mt_call.py: using BVCI 36996 23:33:16.507056 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:16.519631 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:16.532160 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:16.545883 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:16.559493 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:16.573176 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:33:16.699923 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:33:16.821296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:17.366411 run create_hlr_db(pid=13519): Launched 23:33:17.489326 bus /sierra_2: Setting Powered False 23:33:18.552655 run create_hlr_db(pid=13519): Terminated: ok {rc=0} 23:33:18.996218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13521): Launched 23:33:19.314714 run osmo-hlr_10.42.42.2(pid=13522): Launched 23:33:19.436899 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:19.986545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13524): Launched 23:33:20.303428 run osmo-stp_10.42.42.5(pid=13525): Launched 23:33:20.424722 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:20.999846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13527): Launched 23:33:21.300805 run osmo-msc_10.42.42.6(pid=13528): Launched 23:33:21.466614 run osmo-stp_10.42.42.5(pid=13525): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13525)] 23:33:21.593530 run osmo-stp_10.42.42.5(pid=13525): stdout: | (launched: 2022-12-13_23:33:20.246112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:21.719209 run osmo-stp_10.42.42.5(pid=13525): stderr: | [0;m[38;5;43m20221213233320438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233320438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233320438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233320439 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233320439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233320439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233320439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:21.843829 run osmo-stp_10.42.42.5(pid=13525): stdout: | (launched: 2022-12-13_23:33:20.246112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:21.962368 run osmo-stp_10.42.42.5(pid=13525): stderr: | [0;m[38;5;43m20221213233320438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233320438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233320438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233320439 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233320439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233320439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233320439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:22.104505 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13525): Process ended prematurely: osmo-stp_10.42.42.5(pid=13525) [trial-2396↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13525)] [trial-2396↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 23:33:22.113567 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:33:22.139610 run osmo-hlr_10.42.42.2(pid=13522): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13522)] 23:33:22.187168 run osmo-hlr_10.42.42.2(pid=13522): stdout: | (launched: 2022-12-13_23:33:19.257101) 23:33:22.236800 run osmo-hlr_10.42.42.2(pid=13522): stderr: | [0;m[1;31m20221213233319455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233319455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233319455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233319455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233319455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233319455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233319467 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233319476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233319476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233319476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:22.305591 run osmo-msc_10.42.42.6(pid=13528): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13528)] 23:33:22.353193 run osmo-msc_10.42.42.6(pid=13528): stdout: | (launched: 2022-12-13_23:33:21.246913) 23:33:22.402028 run osmo-msc_10.42.42.6(pid=13528): stderr: | [0;m[38;5;43m20221213233321517 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233321518 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f845744ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233321518 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233321518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233321518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233321518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233321520 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233321520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233321520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233321521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:22.451126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13521): Terminating (SIGTERM) 23:33:22.490390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13524): Terminating (SIGTERM) 23:33:22.529962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13527): Terminating (SIGTERM) 23:33:22.570401 --- ParallelTerminationStrategy: PID 13521 died... 23:33:22.589416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13521): Terminated: ok {rc=0} 23:33:22.632854 --- ParallelTerminationStrategy: PID 13524 died... 23:33:22.651750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13524): Terminated: ok {rc=0} 23:33:22.695005 --- ParallelTerminationStrategy: PID 13527 died... 23:33:22.713464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13527): Terminated: ok {rc=0} 23:33:22.798617 bus /sierra_3: Setting Powered False 23:33:23.896726 bus /sierra_3: Setting Powered False 23:33:25.010862 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 23:33:26.155208 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:26.167073 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:33:26.218498 tst mo_mt_call_osmux.py: using LAC 36996 23:33:26.337089 tst mo_mt_call_osmux.py: using RAC 21 23:33:26.455681 tst mo_mt_call_osmux.py: using CellId 36996 23:33:26.574410 tst mo_mt_call_osmux.py: using BVCI 36997 23:33:26.682423 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:26.693679 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:26.704795 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:26.715846 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:26.727114 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:26.738335 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:33:26.858615 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:33:26.980009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:27.442606 run create_hlr_db(pid=13530): Launched 23:33:27.564563 bus /sierra_2: Setting Powered False 23:33:28.625199 run create_hlr_db(pid=13530): Terminated: ok {rc=0} 23:33:29.061665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13532): Launched 23:33:29.378812 run osmo-hlr_10.42.42.2(pid=13533): Launched 23:33:29.500011 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:30.045257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13535): Launched 23:33:30.361046 run osmo-stp_10.42.42.5(pid=13536): Launched 23:33:30.482422 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:31.075161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13538): Launched 23:33:31.409671 run osmo-msc_10.42.42.6(pid=13539): Launched 23:33:31.872599 run osmo-stp_10.42.42.5(pid=13536): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13536)] 23:33:32.113189 run osmo-stp_10.42.42.5(pid=13536): stdout: | (launched: 2022-12-13_23:33:30.303801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:32.289232 run osmo-stp_10.42.42.5(pid=13536): stderr: | [0;m[38;5;43m20221213233330495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233330495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233330496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233330496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233330497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233330497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233330497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:32.420018 run osmo-stp_10.42.42.5(pid=13536): stdout: | (launched: 2022-12-13_23:33:30.303801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:32.560785 run osmo-stp_10.42.42.5(pid=13536): stderr: | [0;m[38;5;43m20221213233330495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233330495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233330496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233330496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233330497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233330497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233330497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:32.715023 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13536): Process ended prematurely: osmo-stp_10.42.42.5(pid=13536) [trial-2396↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13536)] [trial-2396↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 23:33:32.724492 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 23:33:32.752143 run osmo-hlr_10.42.42.2(pid=13533): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13533)] 23:33:32.803887 run osmo-hlr_10.42.42.2(pid=13533): stdout: | (launched: 2022-12-13_23:33:29.321547) 23:33:32.857186 run osmo-hlr_10.42.42.2(pid=13533): stderr: | [0;m[1;31m20221213233329516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233329516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233329516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233329516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233329516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233329516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233329528 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233329536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233329536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233329536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:32.930664 run osmo-msc_10.42.42.6(pid=13539): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13539)] 23:33:32.980740 run osmo-msc_10.42.42.6(pid=13539): stdout: | (launched: 2022-12-13_23:33:31.339350) 23:33:33.033839 run osmo-msc_10.42.42.6(pid=13539): stderr: | [0;m[38;5;43m20221213233331711 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233331711 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f086dc35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233331712 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233331712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233331712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233331712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233331715 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233331715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233331715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233331715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:33.086707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13532): Terminating (SIGTERM) 23:33:33.128313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13535): Terminating (SIGTERM) 23:33:33.171366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13538): Terminating (SIGTERM) 23:33:33.214275 --- ParallelTerminationStrategy: PID 13532 died... 23:33:33.234704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13532): Terminated: ok {rc=0} 23:33:33.281832 --- ParallelTerminationStrategy: PID 13535 died... 23:33:33.302328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13535): Terminated: ok {rc=0} 23:33:33.349160 --- ParallelTerminationStrategy: PID 13538 died... 23:33:33.369524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13538): Terminated: ok {rc=0} 23:33:33.458709 bus /sierra_3: Setting Powered False 23:33:34.557021 bus /sierra_3: Setting Powered False 23:33:35.672868 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 emergency:trx-b200 --------------------------------------------------------------------- 23:33:36.920198 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:33:36.924389 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 23:33:36.956906 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 23:33:36.983505 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 23:33:37.067155 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 23:33:37.100119 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 23:33:37.126472 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 23:33:37.709642 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2396 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 23:33:37.714520 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:37.725052 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 23:33:37.775376 tst emergency_mo_mt_call.py: using LAC 36997 23:33:37.889211 tst emergency_mo_mt_call.py: using RAC 22 23:33:38.002533 tst emergency_mo_mt_call.py: using CellId 36997 23:33:38.115841 tst emergency_mo_mt_call.py: using BVCI 36998 23:33:38.221689 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:38.232371 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:38.242790 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:38.253080 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:38.263387 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:38.275170 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:38.395326 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:38.508647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:38.962117 run create_hlr_db(pid=13544): Launched 23:33:39.081441 bus /sierra_2: Setting Powered False 23:33:40.140120 run create_hlr_db(pid=13544): Terminated: ok {rc=0} 23:33:40.569409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13546): Launched 23:33:40.881688 run osmo-hlr_10.42.42.2(pid=13547): Launched 23:33:41.002262 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:41.544847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13549): Launched 23:33:41.857613 run osmo-stp_10.42.42.5(pid=13550): Launched 23:33:41.988406 tst emergency_mo_mt_call.py: using MSISDN 8389 23:33:42.151490 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:42.713658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13552): Launched 23:33:43.025851 run osmo-msc_10.42.42.6(pid=13553): Launched 23:33:43.199798 run osmo-stp_10.42.42.5(pid=13550): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13550)] 23:33:43.332338 run osmo-stp_10.42.42.5(pid=13550): stdout: | (launched: 2022-12-13_23:33:41.801269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:43.465455 run osmo-stp_10.42.42.5(pid=13550): stderr: | [0;m[38;5;43m20221213233341992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233341993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233341993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233341993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233341994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233341994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233341994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:43.597568 run osmo-stp_10.42.42.5(pid=13550): stdout: | (launched: 2022-12-13_23:33:41.801269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:43.722134 run osmo-stp_10.42.42.5(pid=13550): stderr: | [0;m[38;5;43m20221213233341992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233341993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233341993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233341993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233341994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233341994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233341994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:43.870963 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13550): Process ended prematurely: osmo-stp_10.42.42.5(pid=13550) [trial-2396↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13550)] [trial-2396↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 23:33:43.880060 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 23:33:43.907558 run osmo-hlr_10.42.42.2(pid=13547): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13547)] 23:33:43.958493 run osmo-hlr_10.42.42.2(pid=13547): stdout: | (launched: 2022-12-13_23:33:40.825304) 23:33:44.010682 run osmo-hlr_10.42.42.2(pid=13547): stderr: | [0;m[1;31m20221213233341022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233341022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233341022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233341022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233341022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233341022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233341044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233341054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233341055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233341055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:44.082976 run osmo-msc_10.42.42.6(pid=13553): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13553)] 23:33:44.132623 run osmo-msc_10.42.42.6(pid=13553): stdout: | (launched: 2022-12-13_23:33:42.969419) 23:33:44.184534 run osmo-msc_10.42.42.6(pid=13553): stderr: | [0;m[38;5;43m20221213233343288 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233343288 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f03c4f52c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233343288 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233343289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233343289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233343289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233343291 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233343291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233343292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233343292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:44.236767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13546): Terminating (SIGTERM) 23:33:44.278351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13549): Terminating (SIGTERM) 23:33:44.320126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13552): Terminating (SIGTERM) 23:33:44.362354 --- ParallelTerminationStrategy: PID 13546 died... 23:33:44.382669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13546): Terminated: ok {rc=0} 23:33:44.429111 --- ParallelTerminationStrategy: PID 13549 died... 23:33:44.449063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13549): Terminated: ok {rc=0} 23:33:44.495063 --- ParallelTerminationStrategy: PID 13552 died... 23:33:44.515027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13552): Terminated: ok {rc=0} 23:33:44.601259 bus /sierra_3: Setting Powered False 23:33:45.698293 bus /sierra_3: Setting Powered False 23:33:46.813560 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 23:33:47.901884 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:47.913057 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 23:33:47.962537 tst emergency_preemptive_call.py: using LAC 36998 23:33:48.081025 tst emergency_preemptive_call.py: using RAC 23 23:33:48.194931 tst emergency_preemptive_call.py: using CellId 36998 23:33:48.309937 tst emergency_preemptive_call.py: using BVCI 36999 23:33:48.415730 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:48.426585 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:48.437325 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:48.447796 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:48.458666 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:48.469185 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:48.583073 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:48.702545 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:48.817082 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:48.935252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:49.421102 run create_hlr_db(pid=13555): Launched 23:33:49.540121 bus /sierra_2: Setting Powered False 23:33:50.602648 run create_hlr_db(pid=13555): Terminated: ok {rc=0} 23:33:51.039107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13557): Launched 23:33:51.351202 run osmo-hlr_10.42.42.2(pid=13558): Launched 23:33:51.470958 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:52.011334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13560): Launched 23:33:52.324102 run osmo-stp_10.42.42.5(pid=13561): Launched 23:33:52.451702 tst emergency_preemptive_call.py: using MSISDN 8390 23:33:52.617080 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:53.177178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13563): Launched 23:33:53.489224 run osmo-msc_10.42.42.6(pid=13564): Launched 23:33:53.663790 run osmo-stp_10.42.42.5(pid=13561): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13561)] 23:33:53.797577 run osmo-stp_10.42.42.5(pid=13561): stdout: | (launched: 2022-12-13_23:33:52.267487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:53.932265 run osmo-stp_10.42.42.5(pid=13561): stderr: | [0;m[38;5;43m20221213233352458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233352458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233352458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233352459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233352461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233352461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233352461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:54.065808 run osmo-stp_10.42.42.5(pid=13561): stdout: | (launched: 2022-12-13_23:33:52.267487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:54.191066 run osmo-stp_10.42.42.5(pid=13561): stderr: | [0;m[38;5;43m20221213233352458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233352458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233352458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233352459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233352461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233352461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233352461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:54.340941 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13561): Process ended prematurely: osmo-stp_10.42.42.5(pid=13561) [trial-2396↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13561)] [trial-2396↪emergency:trx-b200↪emergency_preemptive_call.py:32] 23:33:54.349908 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 23:33:54.377171 run osmo-hlr_10.42.42.2(pid=13558): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13558)] 23:33:54.428322 run osmo-hlr_10.42.42.2(pid=13558): stdout: | (launched: 2022-12-13_23:33:51.294825) 23:33:54.481205 run osmo-hlr_10.42.42.2(pid=13558): stderr: | [0;m[1;31m20221213233351488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233351488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233351488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233351488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233351488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233351488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233351510 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233351520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233351520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233351520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:54.554139 run osmo-msc_10.42.42.6(pid=13564): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13564)] 23:33:54.604368 run osmo-msc_10.42.42.6(pid=13564): stdout: | (launched: 2022-12-13_23:33:53.432657) 23:33:54.656816 run osmo-msc_10.42.42.6(pid=13564): stderr: | [0;m[38;5;43m20221213233353753 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233353753 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f94c452ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233353753 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233353753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233353753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233353754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233353755 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233353756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233353756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233353756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:54.709364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13557): Terminating (SIGTERM) 23:33:54.751278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13560): Terminating (SIGTERM) 23:33:54.793859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13563): Terminating (SIGTERM) 23:33:54.836340 --- ParallelTerminationStrategy: PID 13557 died... 23:33:54.856769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13557): Terminated: ok {rc=0} 23:33:54.903731 --- ParallelTerminationStrategy: PID 13560 died... 23:33:54.923608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13560): Terminated: ok {rc=0} 23:33:54.970231 --- ParallelTerminationStrategy: PID 13563 died... 23:33:54.990133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13563): Terminated: ok {rc=0} 23:33:55.078782 bus /sierra_9: Setting Powered False 23:33:56.178108 bus /sierra_9: Setting Powered False 23:33:57.296274 bus /sierra_8: Setting Powered False 23:33:58.395077 bus /sierra_8: Setting Powered False 23:33:59.509794 bus /sierra_3: Setting Powered False 23:34:00.607829 bus /sierra_3: Setting Powered False 23:34:01.733334 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-b200 --------------------------------------------------------------------- 23:34:03.026170 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:34:03.031003 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 23:34:03.064053 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 23:34:03.103799 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 23:34:03.194851 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 23:34:03.231397 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 23:34:03.270982 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 23:34:03.856907 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 23:34:03.909986 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:03.920854 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:34:03.973116 tst cs_paging_gprs_active.py: using LAC 36999 23:34:04.091552 tst cs_paging_gprs_active.py: using RAC 24 23:34:04.209348 tst cs_paging_gprs_active.py: using CellId 36999 23:34:04.327704 tst cs_paging_gprs_active.py: using BVCI 37000 23:34:04.437903 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:04.448307 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:04.458636 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:04.468917 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:04.479108 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:04.489753 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:04.500028 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:04.510259 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:04.520561 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:04.639877 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:04.756447 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:34:04.959071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:05.259121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13570): Launched 23:34:05.519570 run iperf3-srv_10.42.42.10(pid=13571): Launched 23:34:05.631067 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:34:05.831428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:06.131128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13572): Launched 23:34:06.390477 run iperf3-srv_10.42.42.10(pid=13573): Launched 23:34:06.501789 tst cs_paging_gprs_active.py:38: start network... 23:34:06.701209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:07.161664 run create_hlr_db(pid=13574): Launched 23:34:07.282814 bus /sierra_2: Setting Powered False 23:34:08.342934 run create_hlr_db(pid=13574): Terminated: ok {rc=0} 23:34:08.778149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13576): Launched 23:34:09.097169 run osmo-hlr_10.42.42.2(pid=13577): Launched 23:34:09.218794 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:09.765313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13579): Launched 23:34:10.083104 run osmo-stp_10.42.42.5(pid=13580): Launched 23:34:10.205615 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:10.757681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13582): Launched 23:34:10.880045 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:11.150747 run patchelf(pid=13583): Launched 23:34:11.328111 run osmo-stp_10.42.42.5(pid=13580): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13580)] 23:34:11.464235 run osmo-stp_10.42.42.5(pid=13580): stdout: | (launched: 2022-12-13_23:34:10.025995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:11.601985 run osmo-stp_10.42.42.5(pid=13580): stderr: | [0;m[38;5;43m20221213233410217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233410218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233410218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233410218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233410219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233410219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233410219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:11.739533 run osmo-stp_10.42.42.5(pid=13580): stdout: | (launched: 2022-12-13_23:34:10.025995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:11.870787 run osmo-stp_10.42.42.5(pid=13580): stderr: | [0;m[38;5;43m20221213233410217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233410218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233410218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233410218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233410219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233410219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233410219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:12.027439 run patchelf(pid=13583): Terminating (SIGINT) 23:34:12.206837 run patchelf(pid=13583): Terminated: ok {rc=0} 23:34:12.336374 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13580): Process ended prematurely: osmo-stp_10.42.42.5(pid=13580) [trial-2396↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13580)] [trial-2396↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 23:34:12.346998 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:34:12.375559 run osmo-hlr_10.42.42.2(pid=13577): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13577)] 23:34:12.426066 run osmo-hlr_10.42.42.2(pid=13577): stdout: | (launched: 2022-12-13_23:34:09.039867) 23:34:12.478615 run osmo-hlr_10.42.42.2(pid=13577): stderr: | [0;m[1;31m20221213233409239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233409239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233409239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233409239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233409239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233409239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233409252 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233409262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233409263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233409263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:34:12.531011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13570): Terminating (SIGTERM) 23:34:12.572569 run iperf3-srv_10.42.42.10(pid=13571): Terminating (SIGTERM) 23:34:12.614960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13572): Terminating (SIGTERM) 23:34:12.657224 run iperf3-srv_10.42.42.10(pid=13573): Terminating (SIGTERM) 23:34:12.698884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13576): Terminating (SIGTERM) 23:34:12.740866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13579): Terminating (SIGTERM) 23:34:12.782752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13582): Terminating (SIGTERM) 23:34:12.825170 --- ParallelTerminationStrategy: PID 13570 died... 23:34:12.845512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13570): Terminated: ok {rc=0} 23:34:12.891951 --- ParallelTerminationStrategy: PID 13571 died... 23:34:12.911977 run iperf3-srv_10.42.42.10(pid=13571): Terminated {rc=256} 23:34:12.958464 --- ParallelTerminationStrategy: PID 13572 died... 23:34:12.978325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13572): Terminated: ok {rc=0} 23:34:13.024128 --- ParallelTerminationStrategy: PID 13573 died... 23:34:13.044011 run iperf3-srv_10.42.42.10(pid=13573): Terminated {rc=256} 23:34:13.089614 --- ParallelTerminationStrategy: PID 13576 died... 23:34:13.109450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13576): Terminated: ok {rc=0} 23:34:13.155310 --- ParallelTerminationStrategy: PID 13579 died... 23:34:13.174826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13579): Terminated: ok {rc=0} 23:34:13.221076 --- ParallelTerminationStrategy: PID 13582 died... 23:34:13.241079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13582): Terminated: ok {rc=0} 23:34:13.329598 bus /gobi_0: Setting Powered False 23:34:14.428204 bus /gobi_0: Setting Powered False 23:34:15.542987 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200 iperf3.py ---------------------------------------------- 23:34:16.693720 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:16.706318 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:34:16.760642 tst iperf3.py: using LAC 37000 23:34:16.879715 tst iperf3.py: using RAC 25 23:34:17.034324 tst iperf3.py: using CellId 37000 23:34:17.181776 tst iperf3.py: using BVCI 37001 23:34:17.300791 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:17.311918 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:17.322973 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:17.333823 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:17.344859 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:17.355914 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:17.367215 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:17.378309 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:17.389480 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:17.505928 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:34:17.707160 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:18.006510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13584): Launched 23:34:18.265875 run iperf3-srv_10.42.42.10(pid=13585): Launched 23:34:18.377998 tst iperf3.py:8: start network... 23:34:18.578459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:19.037630 run create_hlr_db(pid=13586): Launched 23:34:19.160510 bus /gobi_6: Setting Powered False 23:34:20.224196 run create_hlr_db(pid=13586): Terminated: ok {rc=0} 23:34:20.665496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13588): Launched 23:34:20.982205 run osmo-hlr_10.42.42.2(pid=13589): Launched 23:34:21.103140 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:21.654273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13591): Launched 23:34:21.975641 run osmo-stp_10.42.42.5(pid=13592): Launched 23:34:22.097516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:22.645113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13594): Launched 23:34:22.766771 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:23.035208 run patchelf(pid=13595): Launched 23:34:23.211662 run osmo-stp_10.42.42.5(pid=13592): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13592)] 23:34:23.346565 run osmo-stp_10.42.42.5(pid=13592): stdout: | (launched: 2022-12-13_23:34:21.914786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:23.482800 run osmo-stp_10.42.42.5(pid=13592): stderr: | [0;m[38;5;43m20221213233422109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233422109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233422110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233422110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233422110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233422110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233422111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:23.619186 run osmo-stp_10.42.42.5(pid=13592): stdout: | (launched: 2022-12-13_23:34:21.914786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:23.749539 run osmo-stp_10.42.42.5(pid=13592): stderr: | [0;m[38;5;43m20221213233422109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233422109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233422110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233422110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233422110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233422110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233422111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:23.903803 run patchelf(pid=13595): Terminating (SIGINT) 23:34:24.083425 run patchelf(pid=13595): Terminated: ok {rc=0} 23:34:24.211893 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13592): Process ended prematurely: osmo-stp_10.42.42.5(pid=13592) [trial-2396↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13592)] [trial-2396↪gprs:trx-b200↪iperf3.py:8] 23:34:24.222018 tst iperf3.py:8: Test FAILED (7.6 sec) 23:34:24.250139 run osmo-hlr_10.42.42.2(pid=13589): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13589)] 23:34:24.300546 run osmo-hlr_10.42.42.2(pid=13589): stdout: | (launched: 2022-12-13_23:34:20.924768) 23:34:24.352419 run osmo-hlr_10.42.42.2(pid=13589): stderr: | [0;m[1;31m20221213233421119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233421119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233421120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233421120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233421120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233421120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233421131 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233421141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233421141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233421141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:34:24.404572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13584): Terminating (SIGTERM) 23:34:24.446776 run iperf3-srv_10.42.42.10(pid=13585): Terminating (SIGTERM) 23:34:24.488703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13588): Terminating (SIGTERM) 23:34:24.530765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13591): Terminating (SIGTERM) 23:34:24.572357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13594): Terminating (SIGTERM) 23:34:24.614798 --- ParallelTerminationStrategy: PID 13584 died... 23:34:24.634982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13584): Terminated: ok {rc=0} 23:34:24.681079 --- ParallelTerminationStrategy: PID 13585 died... 23:34:24.700581 run iperf3-srv_10.42.42.10(pid=13585): Terminated {rc=256} 23:34:24.746106 --- ParallelTerminationStrategy: PID 13588 died... 23:34:24.765577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13588): Terminated: ok {rc=0} 23:34:24.811027 --- ParallelTerminationStrategy: PID 13591 died... 23:34:24.830627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13591): Terminated: ok {rc=0} 23:34:24.876096 --- ParallelTerminationStrategy: PID 13594 died... 23:34:24.895668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13594): Terminated: ok {rc=0} 23:34:24.982549 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 23:34:26.134125 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:26.147509 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:34:26.194448 tst iperf3m4.py: using LAC 37001 23:34:26.314580 tst iperf3m4.py: using RAC 26 23:34:26.434019 tst iperf3m4.py: using CellId 37001 23:34:26.550874 tst iperf3m4.py: using BVCI 37002 23:34:26.658786 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:26.669636 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:26.680182 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:26.690797 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:26.701361 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:26.712127 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:26.723231 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:26.734224 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:26.744759 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:26.864752 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:26.983665 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:27.102646 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:27.222037 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:34:27.438129 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:27.759537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13596): Launched 23:34:28.037719 run iperf3-srv_10.42.42.10(pid=13597): Launched 23:34:28.157630 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:34:28.373578 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:28.693238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13598): Launched 23:34:28.969973 run iperf3-srv_10.42.42.10(pid=13599): Launched 23:34:29.089794 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:34:29.305120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:29.625248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13600): Launched 23:34:29.901369 run iperf3-srv_10.42.42.10(pid=13601): Launched 23:34:30.021151 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:34:30.235935 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:30.554500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13602): Launched 23:34:30.845267 run iperf3-srv_10.42.42.10(pid=13603): Launched 23:34:30.973063 tst iperf3m4.py:8: start network... 23:34:31.190678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:31.691329 run create_hlr_db(pid=13604): Launched 23:34:31.848421 bus /gobi_6: Setting Powered False 23:34:32.908359 run create_hlr_db(pid=13604): Terminated: ok {rc=0} 23:34:33.343465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13606): Launched 23:34:33.662156 run osmo-hlr_10.42.42.2(pid=13607): Launched 23:34:33.783653 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:34.336436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13609): Launched 23:34:34.654884 run osmo-stp_10.42.42.5(pid=13610): Launched 23:34:34.776012 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:35.326156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13612): Launched 23:34:35.447512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:35.717715 run patchelf(pid=13613): Launched 23:34:35.894892 run osmo-stp_10.42.42.5(pid=13610): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13610)] 23:34:36.031083 run osmo-stp_10.42.42.5(pid=13610): stdout: | (launched: 2022-12-13_23:34:34.597224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:36.167891 run osmo-stp_10.42.42.5(pid=13610): stderr: | [0;m[38;5;43m20221213233434787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233434787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233434788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233434788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233434790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233434791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233434791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:36.305137 run osmo-stp_10.42.42.5(pid=13610): stdout: | (launched: 2022-12-13_23:34:34.597224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:36.436459 run osmo-stp_10.42.42.5(pid=13610): stderr: | [0;m[38;5;43m20221213233434787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233434787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233434788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233434788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233434790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233434791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233434791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:36.592332 run patchelf(pid=13613): Terminating (SIGINT) 23:34:36.771901 run patchelf(pid=13613): Terminated: ok {rc=0} 23:34:36.901214 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13610): Process ended prematurely: osmo-stp_10.42.42.5(pid=13610) [trial-2396↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13610)] [trial-2396↪gprs:trx-b200↪iperf3m4.py:8] 23:34:36.911344 tst iperf3m4.py:8: Test FAILED (10.8 sec) 23:34:36.940303 run osmo-hlr_10.42.42.2(pid=13607): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13607)] 23:34:36.990853 run osmo-hlr_10.42.42.2(pid=13607): stdout: | (launched: 2022-12-13_23:34:33.604144) 23:34:37.042482 run osmo-hlr_10.42.42.2(pid=13607): stderr: | [0;m[1;31m20221213233433803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233433803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233433803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233433803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233433803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233433803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233433816 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233433824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233433824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233433824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:34:37.094687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13596): Terminating (SIGTERM) 23:34:37.136699 run iperf3-srv_10.42.42.10(pid=13597): Terminating (SIGTERM) 23:34:37.178456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13598): Terminating (SIGTERM) 23:34:37.220847 run iperf3-srv_10.42.42.10(pid=13599): Terminating (SIGTERM) 23:34:37.262527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13600): Terminating (SIGTERM) 23:34:37.304448 run iperf3-srv_10.42.42.10(pid=13601): Terminating (SIGTERM) 23:34:37.345993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13602): Terminating (SIGTERM) 23:34:37.387696 run iperf3-srv_10.42.42.10(pid=13603): Terminating (SIGTERM) 23:34:37.429146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13606): Terminating (SIGTERM) 23:34:37.471407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13609): Terminating (SIGTERM) 23:34:37.513593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13612): Terminating (SIGTERM) 23:34:37.556126 --- ParallelTerminationStrategy: PID 13596 died... 23:34:37.576558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13596): Terminated: ok {rc=0} 23:34:37.622936 --- ParallelTerminationStrategy: PID 13597 died... 23:34:37.642745 run iperf3-srv_10.42.42.10(pid=13597): Terminated {rc=256} 23:34:37.688729 --- ParallelTerminationStrategy: PID 13598 died... 23:34:37.708444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13598): Terminated: ok {rc=0} 23:34:37.754464 --- ParallelTerminationStrategy: PID 13599 died... 23:34:37.774308 run iperf3-srv_10.42.42.10(pid=13599): Terminated {rc=256} 23:34:37.820191 --- ParallelTerminationStrategy: PID 13600 died... 23:34:37.840040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13600): Terminated: ok {rc=0} 23:34:37.886475 --- ParallelTerminationStrategy: PID 13601 died... 23:34:37.906220 run iperf3-srv_10.42.42.10(pid=13601): Terminated {rc=256} 23:34:37.952362 --- ParallelTerminationStrategy: PID 13602 died... 23:34:37.972308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13602): Terminated: ok {rc=0} 23:34:38.018236 --- ParallelTerminationStrategy: PID 13603 died... 23:34:38.037856 run iperf3-srv_10.42.42.10(pid=13603): Terminated {rc=256} 23:34:38.083663 --- ParallelTerminationStrategy: PID 13606 died... 23:34:38.103493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13606): Terminated: ok {rc=0} 23:34:38.149366 --- ParallelTerminationStrategy: PID 13609 died... 23:34:38.169289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13609): Terminated: ok {rc=0} 23:34:38.215012 --- ParallelTerminationStrategy: PID 13612 died... 23:34:38.234860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13612): Terminated: ok {rc=0} 23:34:38.322429 bus /gobi_4: Setting Powered False 23:34:39.421337 bus /gobi_4: Setting Powered False 23:34:40.537064 bus /gobi_1: Setting Powered False 23:34:41.634716 bus /gobi_1: Setting Powered False 23:34:42.751620 bus /gobi_0: Setting Powered False 23:34:43.849747 bus /gobi_0: Setting Powered False 23:34:44.964639 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200 ping.py ---------------------------------------------- 23:34:46.073802 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:46.089994 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:34:46.149232 tst ping.py: using LAC 37002 23:34:46.285750 tst ping.py: using RAC 27 23:34:46.406939 tst ping.py: using CellId 37002 23:34:46.533526 tst ping.py: using BVCI 37003 23:34:46.643262 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:46.654321 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:46.666117 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:46.677630 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:46.688878 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:46.699761 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:46.710849 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:46.721955 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:46.857432 tst ping.py:19: start network... 23:34:47.120012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:47.608181 run create_hlr_db(pid=13614): Launched 23:34:47.727572 bus /gobi_6: Setting Powered False 23:34:48.790721 run create_hlr_db(pid=13614): Terminated: ok {rc=0} 23:34:49.227757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13616): Launched 23:34:49.540187 run osmo-hlr_10.42.42.2(pid=13617): Launched 23:34:49.659485 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:50.201944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13619): Launched 23:34:50.513930 run osmo-stp_10.42.42.5(pid=13620): Launched 23:34:50.633213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:51.172254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13622): Launched 23:34:51.287440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:51.533608 run patchelf(pid=13623): Launched 23:34:51.696509 run osmo-stp_10.42.42.5(pid=13620): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13620)] 23:34:51.820640 run osmo-stp_10.42.42.5(pid=13620): stdout: | (launched: 2022-12-13_23:34:50.457375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:51.946489 run osmo-stp_10.42.42.5(pid=13620): stderr: | [0;m[38;5;43m20221213233450647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233450647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233450647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233450647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233450648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233450648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233450648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:52.071960 run osmo-stp_10.42.42.5(pid=13620): stdout: | (launched: 2022-12-13_23:34:50.457375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:52.191603 run osmo-stp_10.42.42.5(pid=13620): stderr: | [0;m[38;5;43m20221213233450647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233450647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233450647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233450647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233450648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233450648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233450648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:52.334162 run patchelf(pid=13623): Terminating (SIGINT) 23:34:52.498143 run patchelf(pid=13623): Terminated: ok {rc=0} 23:34:52.616414 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13620): Process ended prematurely: osmo-stp_10.42.42.5(pid=13620) [trial-2396↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13620)] [trial-2396↪gprs:trx-b200↪ping.py:22] 23:34:52.625189 tst ping.py:22: Test FAILED (6.5 sec) 23:34:52.651513 run osmo-hlr_10.42.42.2(pid=13617): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13617)] 23:34:52.698562 run osmo-hlr_10.42.42.2(pid=13617): stdout: | (launched: 2022-12-13_23:34:49.483062) 23:34:52.747333 run osmo-hlr_10.42.42.2(pid=13617): stderr: | [0;m[1;31m20221213233449681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233449681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233449681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233449681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233449681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233449681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233449694 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233449702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233449703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233449703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:34:52.796287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13616): Terminating (SIGTERM) 23:34:52.835659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13619): Terminating (SIGTERM) 23:34:52.874801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13622): Terminating (SIGTERM) 23:34:52.914042 --- ParallelTerminationStrategy: PID 13616 died... 23:34:52.932902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13616): Terminated: ok {rc=0} 23:34:52.976274 --- ParallelTerminationStrategy: PID 13619 died... 23:34:52.994752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13619): Terminated: ok {rc=0} 23:34:53.038325 --- ParallelTerminationStrategy: PID 13622 died... 23:34:53.056784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13622): Terminated: ok {rc=0} 23:34:53.140346 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 23:34:54.226762 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:54.238997 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:34:54.290777 tst ping_idle_ping.py: using LAC 37003 23:34:54.415746 tst ping_idle_ping.py: using RAC 28 23:34:54.538765 tst ping_idle_ping.py: using CellId 37003 23:34:54.661572 tst ping_idle_ping.py: using BVCI 37004 23:34:54.769862 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:54.781119 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:54.792118 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:54.803099 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:54.813933 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:54.824277 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:54.834785 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:54.845763 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:54.957541 tst ping_idle_ping.py:24: start network... 23:34:55.154174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:55.610845 run create_hlr_db(pid=13624): Launched 23:34:55.731279 bus /gobi_6: Setting Powered False 23:34:56.790442 run create_hlr_db(pid=13624): Terminated: ok {rc=0} 23:34:57.201323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13626): Launched 23:34:57.494991 run osmo-hlr_10.42.42.2(pid=13627): Launched 23:34:57.606782 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:58.111515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13629): Launched 23:34:58.403213 run osmo-stp_10.42.42.5(pid=13630): Launched 23:34:58.514336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:59.018327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13632): Launched 23:34:59.130310 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:59.376899 run patchelf(pid=13633): Launched 23:34:59.539602 run osmo-stp_10.42.42.5(pid=13630): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13630)] 23:34:59.663309 run osmo-stp_10.42.42.5(pid=13630): stdout: | (launched: 2022-12-13_23:34:58.349925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:59.789676 run osmo-stp_10.42.42.5(pid=13630): stderr: | [0;m[38;5;43m20221213233458517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233458517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233458517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233458518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233458520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233458520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233458520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:59.915088 run osmo-stp_10.42.42.5(pid=13630): stdout: | (launched: 2022-12-13_23:34:58.349925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:00.035652 run osmo-stp_10.42.42.5(pid=13630): stderr: | [0;m[38;5;43m20221213233458517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233458517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233458517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233458518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233458520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233458520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233458520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:00.178148 run patchelf(pid=13633): Terminating (SIGINT) 23:35:00.342589 run patchelf(pid=13633): Terminated: ok {rc=0} 23:35:00.460891 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13630): Process ended prematurely: osmo-stp_10.42.42.5(pid=13630) [trial-2396↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13630)] [trial-2396↪gprs:trx-b200↪ping_idle_ping.py:27] 23:35:00.469740 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 23:35:00.496066 run osmo-hlr_10.42.42.2(pid=13627): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13627)] 23:35:00.543134 run osmo-hlr_10.42.42.2(pid=13627): stdout: | (launched: 2022-12-13_23:34:57.441314) 23:35:00.591997 run osmo-hlr_10.42.42.2(pid=13627): stderr: | [0;m[1;31m20221213233457617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233457617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233457617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233457617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233457617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233457617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233457630 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233457638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233457638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233457638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:00.641403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13626): Terminating (SIGTERM) 23:35:00.680666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13629): Terminating (SIGTERM) 23:35:00.720069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13632): Terminating (SIGTERM) 23:35:00.759443 --- ParallelTerminationStrategy: PID 13626 died... 23:35:00.778512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13626): Terminated: ok {rc=0} 23:35:00.821967 --- ParallelTerminationStrategy: PID 13629 died... 23:35:00.844394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13629): Terminated: ok {rc=0} 23:35:00.905202 --- ParallelTerminationStrategy: PID 13632 died... 23:35:00.930974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13632): Terminated: ok {rc=0} 23:35:01.023469 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 23:35:02.368730 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:35:02.374380 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:35:02.407643 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:35:02.447314 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:35:02.535360 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:35:02.568589 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:35:02.608208 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:35:03.206988 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:35:03.261474 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:03.272456 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:35:03.322876 tst cs_paging_gprs_active.py: using LAC 37004 23:35:03.440899 tst cs_paging_gprs_active.py: using RAC 29 23:35:03.557609 tst cs_paging_gprs_active.py: using CellId 37004 23:35:03.673362 tst cs_paging_gprs_active.py: using BVCI 37005 23:35:03.785426 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:03.796178 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:03.806681 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:03.817235 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:03.827709 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:03.838632 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:03.849790 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:03.860205 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:03.870769 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:03.991263 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:04.108134 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:35:04.314428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:04.615375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13640): Launched 23:35:04.874945 run iperf3-srv_10.42.42.10(pid=13641): Launched 23:35:04.986817 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:35:05.187142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:05.487005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13642): Launched 23:35:05.745834 run iperf3-srv_10.42.42.10(pid=13643): Launched 23:35:05.858328 tst cs_paging_gprs_active.py:38: start network... 23:35:06.059306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:06.521128 run create_hlr_db(pid=13644): Launched 23:35:06.643424 bus /gobi_6: Setting Powered False 23:35:07.703373 run create_hlr_db(pid=13644): Terminated: ok {rc=0} 23:35:08.138720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13646): Launched 23:35:08.456399 run osmo-hlr_10.42.42.2(pid=13647): Launched 23:35:08.579222 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:09.126848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13649): Launched 23:35:09.446446 run osmo-stp_10.42.42.5(pid=13650): Launched 23:35:09.569106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:10.118928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13652): Launched 23:35:10.242006 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:10.511519 run patchelf(pid=13653): Launched 23:35:10.689253 run osmo-stp_10.42.42.5(pid=13650): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13650)] 23:35:10.824566 run osmo-stp_10.42.42.5(pid=13650): stdout: | (launched: 2022-12-13_23:35:09.389054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:10.962204 run osmo-stp_10.42.42.5(pid=13650): stderr: | [0;m[38;5;43m20221213233509579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233509579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233509580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233509580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233509581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233509581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233509581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:11.099620 run osmo-stp_10.42.42.5(pid=13650): stdout: | (launched: 2022-12-13_23:35:09.389054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:11.231042 run osmo-stp_10.42.42.5(pid=13650): stderr: | [0;m[38;5;43m20221213233509579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233509579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233509580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233509580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233509581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233509581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233509581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:11.386761 run patchelf(pid=13653): Terminating (SIGINT) 23:35:11.566283 run patchelf(pid=13653): Terminated: ok {rc=0} 23:35:11.696055 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13650): Process ended prematurely: osmo-stp_10.42.42.5(pid=13650) [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13650)] [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:35:11.706231 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:35:11.734220 run osmo-hlr_10.42.42.2(pid=13647): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13647)] 23:35:11.784319 run osmo-hlr_10.42.42.2(pid=13647): stdout: | (launched: 2022-12-13_23:35:08.399219) 23:35:11.836359 run osmo-hlr_10.42.42.2(pid=13647): stderr: | [0;m[1;31m20221213233508596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233508596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233508596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233508596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233508597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233508597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233508609 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233508617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233508617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233508617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:11.889208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13640): Terminating (SIGTERM) 23:35:11.931246 run iperf3-srv_10.42.42.10(pid=13641): Terminating (SIGTERM) 23:35:11.974065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13642): Terminating (SIGTERM) 23:35:12.016276 run iperf3-srv_10.42.42.10(pid=13643): Terminating (SIGTERM) 23:35:12.058169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13646): Terminating (SIGTERM) 23:35:12.100195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13649): Terminating (SIGTERM) 23:35:12.142342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13652): Terminating (SIGTERM) 23:35:12.184829 --- ParallelTerminationStrategy: PID 13640 died... 23:35:12.205107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13640): Terminated: ok {rc=0} 23:35:12.251496 --- ParallelTerminationStrategy: PID 13641 died... 23:35:12.271292 run iperf3-srv_10.42.42.10(pid=13641): Terminated {rc=256} 23:35:12.317390 --- ParallelTerminationStrategy: PID 13642 died... 23:35:12.337179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13642): Terminated: ok {rc=0} 23:35:12.383231 --- ParallelTerminationStrategy: PID 13643 died... 23:35:12.402991 run iperf3-srv_10.42.42.10(pid=13643): Terminated {rc=256} 23:35:12.449123 --- ParallelTerminationStrategy: PID 13646 died... 23:35:12.468830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13646): Terminated: ok {rc=0} 23:35:12.515002 --- ParallelTerminationStrategy: PID 13649 died... 23:35:12.534769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13649): Terminated: ok {rc=0} 23:35:12.580852 --- ParallelTerminationStrategy: PID 13652 died... 23:35:12.601022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13652): Terminated: ok {rc=0} 23:35:12.688343 bus /gobi_0: Setting Powered False 23:35:13.784451 bus /gobi_0: Setting Powered False 23:35:14.898428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:35:16.066130 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:16.079274 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:35:16.137453 tst iperf3.py: using LAC 37005 23:35:16.264656 tst iperf3.py: using RAC 30 23:35:16.430240 tst iperf3.py: using CellId 37005 23:35:16.551111 tst iperf3.py: using BVCI 37006 23:35:16.671139 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:16.683485 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:16.695518 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:16.707635 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:16.720769 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:16.734003 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:16.747259 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:16.760261 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:16.773380 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:16.897843 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:35:17.115992 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:17.420833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13654): Launched 23:35:17.681754 run iperf3-srv_10.42.42.10(pid=13655): Launched 23:35:17.800543 tst iperf3.py:8: start network... 23:35:18.001594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:18.462559 run create_hlr_db(pid=13656): Launched 23:35:18.585011 bus /gobi_6: Setting Powered False 23:35:19.644834 run create_hlr_db(pid=13656): Terminated: ok {rc=0} 23:35:20.060831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13658): Launched 23:35:20.358282 run osmo-hlr_10.42.42.2(pid=13659): Launched 23:35:20.470678 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:20.998564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13661): Launched 23:35:21.295360 run osmo-stp_10.42.42.5(pid=13662): Launched 23:35:21.407934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:21.921665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13664): Launched 23:35:22.035477 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:22.287064 run patchelf(pid=13665): Launched 23:35:22.452379 run osmo-stp_10.42.42.5(pid=13662): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13662)] 23:35:22.578349 run osmo-stp_10.42.42.5(pid=13662): stdout: | (launched: 2022-12-13_23:35:21.241098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:22.706170 run osmo-stp_10.42.42.5(pid=13662): stderr: | [0;m[38;5;43m20221213233521410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233521410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233521410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233521410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233521413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233521413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233521413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:22.834194 run osmo-stp_10.42.42.5(pid=13662): stdout: | (launched: 2022-12-13_23:35:21.241098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:22.956058 run osmo-stp_10.42.42.5(pid=13662): stderr: | [0;m[38;5;43m20221213233521410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233521410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233521410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233521410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233521413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233521413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233521413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:23.100537 run patchelf(pid=13665): Terminating (SIGINT) 23:35:23.267822 run patchelf(pid=13665): Terminated: ok {rc=0} 23:35:23.388288 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13662): Process ended prematurely: osmo-stp_10.42.42.5(pid=13662) [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13662)] [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 23:35:23.397660 tst iperf3.py:8: Test FAILED (7.4 sec) 23:35:23.424286 run osmo-hlr_10.42.42.2(pid=13659): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13659)] 23:35:23.471439 run osmo-hlr_10.42.42.2(pid=13659): stdout: | (launched: 2022-12-13_23:35:20.303787) 23:35:23.520434 run osmo-hlr_10.42.42.2(pid=13659): stderr: | [0;m[1;31m20221213233520481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233520481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233520481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233520481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233520481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233520481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233520491 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233520500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233520501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233520501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:23.569920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13654): Terminating (SIGTERM) 23:35:23.609406 run iperf3-srv_10.42.42.10(pid=13655): Terminating (SIGTERM) 23:35:23.648823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13658): Terminating (SIGTERM) 23:35:23.688424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13661): Terminating (SIGTERM) 23:35:23.728067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13664): Terminating (SIGTERM) 23:35:23.767560 --- ParallelTerminationStrategy: PID 13654 died... 23:35:23.786428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13654): Terminated: ok {rc=0} 23:35:23.830151 --- ParallelTerminationStrategy: PID 13655 died... 23:35:23.848416 run iperf3-srv_10.42.42.10(pid=13655): Terminated {rc=256} 23:35:23.891940 --- ParallelTerminationStrategy: PID 13658 died... 23:35:23.910363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13658): Terminated: ok {rc=0} 23:35:23.954260 --- ParallelTerminationStrategy: PID 13661 died... 23:35:23.972468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13661): Terminated: ok {rc=0} 23:35:24.015883 --- ParallelTerminationStrategy: PID 13664 died... 23:35:24.034448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13664): Terminated: ok {rc=0} 23:35:24.119474 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:35:25.264868 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:25.276203 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:35:25.326873 tst iperf3m4.py: using LAC 37006 23:35:25.447842 tst iperf3m4.py: using RAC 31 23:35:25.572050 tst iperf3m4.py: using CellId 37006 23:35:25.698294 tst iperf3m4.py: using BVCI 37007 23:35:25.814507 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:25.825775 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:25.836571 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:25.847579 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:25.858857 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:25.870254 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:25.881759 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:25.892918 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:25.904387 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:26.020309 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:26.140532 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:26.257225 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:26.371997 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:35:26.572408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:26.871924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13666): Launched 23:35:27.131496 run iperf3-srv_10.42.42.10(pid=13667): Launched 23:35:27.243292 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:35:27.442433 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:27.742187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13668): Launched 23:35:28.001587 run iperf3-srv_10.42.42.10(pid=13669): Launched 23:35:28.113113 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:35:28.313140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:28.612149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13670): Launched 23:35:28.871583 run iperf3-srv_10.42.42.10(pid=13671): Launched 23:35:28.983258 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:35:29.182275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:29.480491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13672): Launched 23:35:29.739078 run iperf3-srv_10.42.42.10(pid=13673): Launched 23:35:29.850721 tst iperf3m4.py:8: start network... 23:35:30.050557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:30.511277 run create_hlr_db(pid=13674): Launched 23:35:30.636838 bus /gobi_6: Setting Powered False 23:35:31.699382 run create_hlr_db(pid=13674): Terminated: ok {rc=0} 23:35:32.169771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13676): Launched 23:35:32.475100 run osmo-hlr_10.42.42.2(pid=13677): Launched 23:35:32.589464 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:33.104484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13679): Launched 23:35:33.403034 run osmo-stp_10.42.42.5(pid=13680): Launched 23:35:33.516437 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:34.031622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13682): Launched 23:35:34.146274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:34.399091 run patchelf(pid=13683): Launched 23:35:34.565425 run osmo-stp_10.42.42.5(pid=13680): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13680)] 23:35:34.692116 run osmo-stp_10.42.42.5(pid=13680): stdout: | (launched: 2022-12-13_23:35:33.348753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:34.820332 run osmo-stp_10.42.42.5(pid=13680): stderr: | [0;m[38;5;43m20221213233533518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233533518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233533518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233533518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233533521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233533521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233533521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:34.948789 run osmo-stp_10.42.42.5(pid=13680): stdout: | (launched: 2022-12-13_23:35:33.348753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:35.071437 run osmo-stp_10.42.42.5(pid=13680): stderr: | [0;m[38;5;43m20221213233533518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233533518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233533518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233533518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233533521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233533521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233533521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:35.217203 run patchelf(pid=13683): Terminating (SIGINT) 23:35:35.384589 run patchelf(pid=13683): Terminated: ok {rc=0} 23:35:35.505557 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13680): Process ended prematurely: osmo-stp_10.42.42.5(pid=13680) [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13680)] [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 23:35:35.514891 tst iperf3m4.py:8: Test FAILED (10.3 sec) 23:35:35.542167 run osmo-hlr_10.42.42.2(pid=13677): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13677)] 23:35:35.589477 run osmo-hlr_10.42.42.2(pid=13677): stdout: | (launched: 2022-12-13_23:35:32.420295) 23:35:35.638438 run osmo-hlr_10.42.42.2(pid=13677): stderr: | [0;m[1;31m20221213233532597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233532597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233532597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233532597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233532597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233532597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233532625 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233532635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233532635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233532635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:35.687819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13666): Terminating (SIGTERM) 23:35:35.727526 run iperf3-srv_10.42.42.10(pid=13667): Terminating (SIGTERM) 23:35:35.767203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13668): Terminating (SIGTERM) 23:35:35.807142 run iperf3-srv_10.42.42.10(pid=13669): Terminating (SIGTERM) 23:35:35.846917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13670): Terminating (SIGTERM) 23:35:35.886893 run iperf3-srv_10.42.42.10(pid=13671): Terminating (SIGTERM) 23:35:35.926613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13672): Terminating (SIGTERM) 23:35:35.966399 run iperf3-srv_10.42.42.10(pid=13673): Terminating (SIGTERM) 23:35:36.006028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13676): Terminating (SIGTERM) 23:35:36.046194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13679): Terminating (SIGTERM) 23:35:36.085882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13682): Terminating (SIGTERM) 23:35:36.125884 --- ParallelTerminationStrategy: PID 13666 died... 23:35:36.145255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13666): Terminated: ok {rc=0} 23:35:36.189347 --- ParallelTerminationStrategy: PID 13667 died... 23:35:36.207909 run iperf3-srv_10.42.42.10(pid=13667): Terminated {rc=256} 23:35:36.251569 --- ParallelTerminationStrategy: PID 13668 died... 23:35:36.270454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13668): Terminated: ok {rc=0} 23:35:36.314337 --- ParallelTerminationStrategy: PID 13669 died... 23:35:36.333083 run iperf3-srv_10.42.42.10(pid=13669): Terminated {rc=256} 23:35:36.376808 --- ParallelTerminationStrategy: PID 13670 died... 23:35:36.395997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13670): Terminated: ok {rc=0} 23:35:36.439680 --- ParallelTerminationStrategy: PID 13671 died... 23:35:36.458346 run iperf3-srv_10.42.42.10(pid=13671): Terminated {rc=256} 23:35:36.501987 --- ParallelTerminationStrategy: PID 13672 died... 23:35:36.520598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13672): Terminated: ok {rc=0} 23:35:36.564246 --- ParallelTerminationStrategy: PID 13673 died... 23:35:36.582938 run iperf3-srv_10.42.42.10(pid=13673): Terminated {rc=256} 23:35:36.626410 --- ParallelTerminationStrategy: PID 13676 died... 23:35:36.645322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13676): Terminated: ok {rc=0} 23:35:36.689158 --- ParallelTerminationStrategy: PID 13679 died... 23:35:36.707863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13679): Terminated: ok {rc=0} 23:35:36.751740 --- ParallelTerminationStrategy: PID 13682 died... 23:35:36.770523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13682): Terminated: ok {rc=0} 23:35:36.855834 bus /gobi_4: Setting Powered False 23:35:37.952609 bus /gobi_4: Setting Powered False 23:35:39.063999 bus /gobi_1: Setting Powered False 23:35:40.161366 bus /gobi_1: Setting Powered False 23:35:41.276457 bus /gobi_0: Setting Powered False 23:35:42.370464 bus /gobi_0: Setting Powered False 23:35:43.484773 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 23:35:44.586830 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:44.598253 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:35:44.654805 tst ping.py: using LAC 37007 23:35:44.778289 tst ping.py: using RAC 32 23:35:44.892561 tst ping.py: using CellId 37007 23:35:45.006306 tst ping.py: using BVCI 37008 23:35:45.112351 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:45.123400 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:45.134063 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:45.144814 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:45.155364 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:45.165870 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:45.176507 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:45.187158 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:45.300049 tst ping.py:19: start network... 23:35:45.496515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:45.961067 run create_hlr_db(pid=13684): Launched 23:35:46.115469 bus /gobi_6: Setting Powered False 23:35:47.192388 run create_hlr_db(pid=13684): Terminated: ok {rc=0} 23:35:47.608237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13686): Launched 23:35:47.900127 run osmo-hlr_10.42.42.2(pid=13687): Launched 23:35:48.011093 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:48.532386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13689): Launched 23:35:48.823548 run osmo-stp_10.42.42.5(pid=13690): Launched 23:35:48.934827 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:49.442638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13692): Launched 23:35:49.554906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:49.802070 run patchelf(pid=13693): Launched 23:35:49.964126 run osmo-stp_10.42.42.5(pid=13690): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13690)] 23:35:50.088275 run osmo-stp_10.42.42.5(pid=13690): stdout: | (launched: 2022-12-13_23:35:48.770084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:50.214616 run osmo-stp_10.42.42.5(pid=13690): stderr: | [0;m[38;5;43m20221213233548936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233548936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233548936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233548937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233548940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233548940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233548940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:50.340200 run osmo-stp_10.42.42.5(pid=13690): stdout: | (launched: 2022-12-13_23:35:48.770084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:50.460093 run osmo-stp_10.42.42.5(pid=13690): stderr: | [0;m[38;5;43m20221213233548936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233548936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233548936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233548937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233548940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233548940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233548940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:50.602425 run patchelf(pid=13693): Terminating (SIGINT) 23:35:50.766545 run patchelf(pid=13693): Terminated: ok {rc=0} 23:35:50.884451 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13690): Process ended prematurely: osmo-stp_10.42.42.5(pid=13690) [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13690)] [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 23:35:50.893216 tst ping.py:22: Test FAILED (6.3 sec) 23:35:50.919718 run osmo-hlr_10.42.42.2(pid=13687): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13687)] 23:35:50.967238 run osmo-hlr_10.42.42.2(pid=13687): stdout: | (launched: 2022-12-13_23:35:47.846646) 23:35:51.017050 run osmo-hlr_10.42.42.2(pid=13687): stderr: | [0;m[1;31m20221213233548022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233548022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233548022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233548022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233548022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233548022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233548034 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233548042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233548043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233548043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:51.066571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13686): Terminating (SIGTERM) 23:35:51.106233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13689): Terminating (SIGTERM) 23:35:51.145752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13692): Terminating (SIGTERM) 23:35:51.185809 --- ParallelTerminationStrategy: PID 13686 died... 23:35:51.205112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13686): Terminated: ok {rc=0} 23:35:51.249255 --- ParallelTerminationStrategy: PID 13689 died... 23:35:51.267993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13689): Terminated: ok {rc=0} 23:35:51.311730 --- ParallelTerminationStrategy: PID 13692 died... 23:35:51.330194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13692): Terminated: ok {rc=0} 23:35:51.413054 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:35:52.499012 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:52.511038 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:35:52.565464 tst ping_idle_ping.py: using LAC 37008 23:35:52.683045 tst ping_idle_ping.py: using RAC 33 23:35:52.798787 tst ping_idle_ping.py: using CellId 37008 23:35:52.914625 tst ping_idle_ping.py: using BVCI 37009 23:35:53.022745 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:53.033822 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:53.044394 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:53.054999 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:53.066132 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:53.077289 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:53.088529 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:53.099728 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:53.217663 tst ping_idle_ping.py:24: start network... 23:35:53.424212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:53.881654 run create_hlr_db(pid=13695): Launched 23:35:54.001519 bus /gobi_6: Setting Powered False 23:35:55.060291 run create_hlr_db(pid=13695): Terminated: ok {rc=0} 23:35:55.490916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13697): Launched 23:35:55.803512 run osmo-hlr_10.42.42.2(pid=13698): Launched 23:35:55.923783 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:56.464748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13700): Launched 23:35:56.778462 run osmo-stp_10.42.42.5(pid=13701): Launched 23:35:56.898758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:57.442284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13703): Launched 23:35:57.562319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:57.827485 run patchelf(pid=13704): Launched 23:35:58.002147 run osmo-stp_10.42.42.5(pid=13701): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13701)] 23:35:58.135623 run osmo-stp_10.42.42.5(pid=13701): stdout: | (launched: 2022-12-13_23:35:56.721604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:58.270431 run osmo-stp_10.42.42.5(pid=13701): stderr: | [0;m[38;5;43m20221213233556913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233556913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233556913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233556914 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233556914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233556914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233556914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:58.405826 run osmo-stp_10.42.42.5(pid=13701): stdout: | (launched: 2022-12-13_23:35:56.721604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:58.534447 run osmo-stp_10.42.42.5(pid=13701): stderr: | [0;m[38;5;43m20221213233556913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233556913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233556913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233556914 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233556914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233556914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233556914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:58.687168 run patchelf(pid=13704): Terminating (SIGINT) 23:35:58.863254 run patchelf(pid=13704): Terminated: ok {rc=0} 23:35:58.990719 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13701): Process ended prematurely: osmo-stp_10.42.42.5(pid=13701) [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13701)] [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 23:35:59.000139 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:35:59.028243 run osmo-hlr_10.42.42.2(pid=13698): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13698)] 23:35:59.078481 run osmo-hlr_10.42.42.2(pid=13698): stdout: | (launched: 2022-12-13_23:35:55.746630) 23:35:59.130474 run osmo-hlr_10.42.42.2(pid=13698): stderr: | [0;m[1;31m20221213233555943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233555943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233555943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233555943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233555943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233555943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233555957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233555966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233555967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233555967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:59.182374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13697): Terminating (SIGTERM) 23:35:59.223763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13700): Terminating (SIGTERM) 23:35:59.265742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13703): Terminating (SIGTERM) 23:35:59.308542 --- ParallelTerminationStrategy: PID 13697 died... 23:35:59.328860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13697): Terminated: ok {rc=0} 23:35:59.375637 --- ParallelTerminationStrategy: PID 13700 died... 23:35:59.395574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13700): Terminated: ok {rc=0} 23:35:59.441897 --- ParallelTerminationStrategy: PID 13703 died... 23:35:59.461765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13703): Terminated: ok {rc=0} 23:35:59.549872 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:36:00.883176 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:36:00.890228 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:36:00.944341 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:36:01.001913 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:36:01.107187 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:36:01.150782 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:36:01.199010 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:36:01.811428 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:36:01.881197 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:01.896344 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:36:01.981917 tst cs_paging_gprs_active.py: using LAC 37009 23:36:02.130703 tst cs_paging_gprs_active.py: using RAC 34 23:36:02.277368 tst cs_paging_gprs_active.py: using CellId 37009 23:36:02.403912 tst cs_paging_gprs_active.py: using BVCI 37010 23:36:02.520124 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:02.531426 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:02.542551 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:02.553592 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:02.565295 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:02.577370 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:02.589399 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:02.601198 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:02.613243 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:02.733467 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:02.854292 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:36:03.071263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:03.392086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13708): Launched 23:36:03.669617 run iperf3-srv_10.42.42.10(pid=13709): Launched 23:36:03.789737 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:36:04.006522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:04.328092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13710): Launched 23:36:04.605069 run iperf3-srv_10.42.42.10(pid=13711): Launched 23:36:04.724057 tst cs_paging_gprs_active.py:38: start network... 23:36:04.939531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:05.433527 run create_hlr_db(pid=13712): Launched 23:36:05.555293 bus /gobi_6: Setting Powered False 23:36:06.618758 run create_hlr_db(pid=13712): Terminated: ok {rc=0} 23:36:07.064017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13714): Launched 23:36:07.383800 run osmo-hlr_10.42.42.2(pid=13715): Launched 23:36:07.506699 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:08.037025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13717): Launched 23:36:08.336386 run osmo-stp_10.42.42.5(pid=13718): Launched 23:36:08.450806 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:08.965151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13720): Launched 23:36:09.079463 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:09.332091 run patchelf(pid=13721): Launched 23:36:09.498493 run osmo-stp_10.42.42.5(pid=13718): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13718)] 23:36:09.624847 run osmo-stp_10.42.42.5(pid=13718): stdout: | (launched: 2022-12-13_23:36:08.282046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:09.753616 run osmo-stp_10.42.42.5(pid=13718): stderr: | [0;m[38;5;43m20221213233608452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233608452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233608452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233608453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233608453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233608453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233608453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:09.882689 run osmo-stp_10.42.42.5(pid=13718): stdout: | (launched: 2022-12-13_23:36:08.282046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:10.005361 run osmo-stp_10.42.42.5(pid=13718): stderr: | [0;m[38;5;43m20221213233608452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233608452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233608452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233608453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233608453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233608453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233608453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:10.150745 run patchelf(pid=13721): Terminating (SIGINT) 23:36:10.319491 run patchelf(pid=13721): Terminated: ok {rc=0} 23:36:10.440600 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13718): Process ended prematurely: osmo-stp_10.42.42.5(pid=13718) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13718)] [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:36:10.449949 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 23:36:10.476741 run osmo-hlr_10.42.42.2(pid=13715): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13715)] 23:36:10.524822 run osmo-hlr_10.42.42.2(pid=13715): stdout: | (launched: 2022-12-13_23:36:07.326234) 23:36:10.574367 run osmo-hlr_10.42.42.2(pid=13715): stderr: | [0;m[1;31m20221213233607524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233607524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233607524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233607524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233607524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233607524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233607537 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233607545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233607545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233607545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:10.624277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13708): Terminating (SIGTERM) 23:36:10.664118 run iperf3-srv_10.42.42.10(pid=13709): Terminating (SIGTERM) 23:36:10.703802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13710): Terminating (SIGTERM) 23:36:10.743469 run iperf3-srv_10.42.42.10(pid=13711): Terminating (SIGTERM) 23:36:10.782837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13714): Terminating (SIGTERM) 23:36:10.826706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13717): Terminating (SIGTERM) 23:36:10.869441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13720): Terminating (SIGTERM) 23:36:10.912280 --- ParallelTerminationStrategy: PID 13708 died... 23:36:10.932775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13708): Terminated: ok {rc=0} 23:36:10.980519 --- ParallelTerminationStrategy: PID 13709 died... 23:36:11.001134 run iperf3-srv_10.42.42.10(pid=13709): Terminated {rc=256} 23:36:11.048195 --- ParallelTerminationStrategy: PID 13710 died... 23:36:11.068769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13710): Terminated: ok {rc=0} 23:36:11.115653 --- ParallelTerminationStrategy: PID 13711 died... 23:36:11.135828 run iperf3-srv_10.42.42.10(pid=13711): Terminated {rc=256} 23:36:11.182521 --- ParallelTerminationStrategy: PID 13714 died... 23:36:11.202979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13714): Terminated: ok {rc=0} 23:36:11.250002 --- ParallelTerminationStrategy: PID 13717 died... 23:36:11.270602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13717): Terminated: ok {rc=0} 23:36:11.317708 --- ParallelTerminationStrategy: PID 13720 died... 23:36:11.338270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13720): Terminated: ok {rc=0} 23:36:11.427330 bus /gobi_0: Setting Powered False 23:36:12.526216 bus /gobi_0: Setting Powered False 23:36:13.641482 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:36:14.789553 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:14.801591 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:36:14.876401 tst iperf3.py: using LAC 37010 23:36:15.002174 tst iperf3.py: using RAC 35 23:36:15.128838 tst iperf3.py: using CellId 37010 23:36:15.253639 tst iperf3.py: using BVCI 37011 23:36:15.362559 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:15.373583 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:15.384391 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:15.395306 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:15.405847 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:15.417269 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:15.427973 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:15.438656 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:15.449968 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:15.570189 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:36:15.785784 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:16.121708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13723): Launched 23:36:16.421867 run iperf3-srv_10.42.42.10(pid=13724): Launched 23:36:16.552336 tst iperf3.py:8: start network... 23:36:16.772609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:17.273473 run create_hlr_db(pid=13725): Launched 23:36:17.395907 bus /gobi_6: Setting Powered False 23:36:18.458191 run create_hlr_db(pid=13725): Terminated: ok {rc=0} 23:36:18.884479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13727): Launched 23:36:19.181338 run osmo-hlr_10.42.42.2(pid=13728): Launched 23:36:19.295363 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:19.809096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13730): Launched 23:36:20.106098 run osmo-stp_10.42.42.5(pid=13731): Launched 23:36:20.219708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:20.734623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13733): Launched 23:36:20.848363 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:21.100083 run patchelf(pid=13734): Launched 23:36:21.265940 run osmo-stp_10.42.42.5(pid=13731): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13731)] 23:36:21.392034 run osmo-stp_10.42.42.5(pid=13731): stdout: | (launched: 2022-12-13_23:36:20.052095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:21.520131 run osmo-stp_10.42.42.5(pid=13731): stderr: | [0;m[38;5;43m20221213233620223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233620223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233620223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233620224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233620224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233620224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233620225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:21.648187 run osmo-stp_10.42.42.5(pid=13731): stdout: | (launched: 2022-12-13_23:36:20.052095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:21.770564 run osmo-stp_10.42.42.5(pid=13731): stderr: | [0;m[38;5;43m20221213233620223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233620223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233620223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233620224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233620224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233620224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233620225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:21.915549 run patchelf(pid=13734): Terminating (SIGINT) 23:36:22.083187 run patchelf(pid=13734): Terminated: ok {rc=0} 23:36:22.204212 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13731): Process ended prematurely: osmo-stp_10.42.42.5(pid=13731) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13731)] [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 23:36:22.213617 tst iperf3.py:8: Test FAILED (7.5 sec) 23:36:22.240560 run osmo-hlr_10.42.42.2(pid=13728): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13728)] 23:36:22.288292 run osmo-hlr_10.42.42.2(pid=13728): stdout: | (launched: 2022-12-13_23:36:19.126875) 23:36:22.337659 run osmo-hlr_10.42.42.2(pid=13728): stderr: | [0;m[1;31m20221213233619301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233619301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233619302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233619302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233619302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233619302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233619317 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233619327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233619328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233619328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:22.387880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13723): Terminating (SIGTERM) 23:36:22.427810 run iperf3-srv_10.42.42.10(pid=13724): Terminating (SIGTERM) 23:36:22.467350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13727): Terminating (SIGTERM) 23:36:22.507091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13730): Terminating (SIGTERM) 23:36:22.546860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13733): Terminating (SIGTERM) 23:36:22.586854 --- ParallelTerminationStrategy: PID 13723 died... 23:36:22.606099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13723): Terminated: ok {rc=0} 23:36:22.649904 --- ParallelTerminationStrategy: PID 13724 died... 23:36:22.668435 run iperf3-srv_10.42.42.10(pid=13724): Terminated {rc=256} 23:36:22.712039 --- ParallelTerminationStrategy: PID 13727 died... 23:36:22.730628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13727): Terminated: ok {rc=0} 23:36:22.774463 --- ParallelTerminationStrategy: PID 13730 died... 23:36:22.793260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13730): Terminated: ok {rc=0} 23:36:22.837129 --- ParallelTerminationStrategy: PID 13733 died... 23:36:22.855722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13733): Terminated: ok {rc=0} 23:36:22.940719 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:36:24.086861 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:24.098459 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:36:24.168864 tst iperf3m4.py: using LAC 37011 23:36:24.287270 tst iperf3m4.py: using RAC 36 23:36:24.410505 tst iperf3m4.py: using CellId 37011 23:36:24.527747 tst iperf3m4.py: using BVCI 37012 23:36:24.635737 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:24.646662 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:24.657505 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:24.668212 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:24.678832 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:24.689592 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:24.700256 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:24.710849 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:24.721794 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:24.840757 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:24.958636 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:25.079256 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:25.200090 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:36:25.416458 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:25.736435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13735): Launched 23:36:26.014160 run iperf3-srv_10.42.42.10(pid=13736): Launched 23:36:26.134202 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:36:26.350131 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:26.680002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13737): Launched 23:36:26.957284 run iperf3-srv_10.42.42.10(pid=13738): Launched 23:36:27.078125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:36:27.294248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:27.615136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13739): Launched 23:36:27.892363 run iperf3-srv_10.42.42.10(pid=13740): Launched 23:36:28.012592 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:36:28.228416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:28.548522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13741): Launched 23:36:28.825094 run iperf3-srv_10.42.42.10(pid=13742): Launched 23:36:28.944880 tst iperf3m4.py:8: start network... 23:36:29.160562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:29.655000 run create_hlr_db(pid=13743): Launched 23:36:29.775754 bus /gobi_6: Setting Powered False 23:36:30.844443 run create_hlr_db(pid=13743): Terminated: ok {rc=0} 23:36:31.299804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13745): Launched 23:36:31.645673 run osmo-hlr_10.42.42.2(pid=13746): Launched 23:36:31.838486 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:32.510634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13748): Launched 23:36:32.808576 run osmo-stp_10.42.42.5(pid=13749): Launched 23:36:32.922043 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:33.435513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13751): Launched 23:36:33.549676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:33.801917 run patchelf(pid=13752): Launched 23:36:33.967600 run osmo-stp_10.42.42.5(pid=13749): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13749)] 23:36:34.094321 run osmo-stp_10.42.42.5(pid=13749): stdout: | (launched: 2022-12-13_23:36:32.754242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:34.222214 run osmo-stp_10.42.42.5(pid=13749): stderr: | [0;m[38;5;43m20221213233632923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233632923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233632923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233632923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233632926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233632926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233632926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:34.350536 run osmo-stp_10.42.42.5(pid=13749): stdout: | (launched: 2022-12-13_23:36:32.754242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:34.472574 run osmo-stp_10.42.42.5(pid=13749): stderr: | [0;m[38;5;43m20221213233632923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233632923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233632923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233632923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233632926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233632926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233632926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:34.618075 run patchelf(pid=13752): Terminating (SIGINT) 23:36:34.786448 run patchelf(pid=13752): Terminated: ok {rc=0} 23:36:34.907656 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13749): Process ended prematurely: osmo-stp_10.42.42.5(pid=13749) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13749)] [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:36:34.917009 tst iperf3m4.py:8: Test FAILED (10.9 sec) 23:36:34.944545 run osmo-hlr_10.42.42.2(pid=13746): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13746)] 23:36:34.992434 run osmo-hlr_10.42.42.2(pid=13746): stdout: | (launched: 2022-12-13_23:36:31.575896) 23:36:35.042199 run osmo-hlr_10.42.42.2(pid=13746): stderr: | [0;m[1;31m20221213233631913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233631913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233631913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233631913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233631913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233631915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233631935 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233631948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233631948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233631948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:35.092105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13735): Terminating (SIGTERM) 23:36:35.131995 run iperf3-srv_10.42.42.10(pid=13736): Terminating (SIGTERM) 23:36:35.171678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13737): Terminating (SIGTERM) 23:36:35.211491 run iperf3-srv_10.42.42.10(pid=13738): Terminating (SIGTERM) 23:36:35.251144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13739): Terminating (SIGTERM) 23:36:35.291088 run iperf3-srv_10.42.42.10(pid=13740): Terminating (SIGTERM) 23:36:35.330775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13741): Terminating (SIGTERM) 23:36:35.370718 run iperf3-srv_10.42.42.10(pid=13742): Terminating (SIGTERM) 23:36:35.410486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13745): Terminating (SIGTERM) 23:36:35.450125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13748): Terminating (SIGTERM) 23:36:35.489797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13751): Terminating (SIGTERM) 23:36:35.529826 --- ParallelTerminationStrategy: PID 13735 died... 23:36:35.549055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13735): Terminated: ok {rc=0} 23:36:35.594008 --- ParallelTerminationStrategy: PID 13736 died... 23:36:35.612581 run iperf3-srv_10.42.42.10(pid=13736): Terminated {rc=256} 23:36:35.656620 --- ParallelTerminationStrategy: PID 13737 died... 23:36:35.675430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13737): Terminated: ok {rc=0} 23:36:35.719464 --- ParallelTerminationStrategy: PID 13738 died... 23:36:35.738228 run iperf3-srv_10.42.42.10(pid=13738): Terminated {rc=256} 23:36:35.782220 --- ParallelTerminationStrategy: PID 13739 died... 23:36:35.800812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13739): Terminated: ok {rc=0} 23:36:35.844892 --- ParallelTerminationStrategy: PID 13740 died... 23:36:35.864002 run iperf3-srv_10.42.42.10(pid=13740): Terminated {rc=256} 23:36:35.907822 --- ParallelTerminationStrategy: PID 13741 died... 23:36:35.926398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13741): Terminated: ok {rc=0} 23:36:35.970472 --- ParallelTerminationStrategy: PID 13742 died... 23:36:35.989187 run iperf3-srv_10.42.42.10(pid=13742): Terminated {rc=256} 23:36:36.032921 --- ParallelTerminationStrategy: PID 13745 died... 23:36:36.052041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13745): Terminated: ok {rc=0} 23:36:36.095860 --- ParallelTerminationStrategy: PID 13748 died... 23:36:36.114729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13748): Terminated: ok {rc=0} 23:36:36.158447 --- ParallelTerminationStrategy: PID 13751 died... 23:36:36.177197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13751): Terminated: ok {rc=0} 23:36:36.262638 bus /gobi_4: Setting Powered False 23:36:37.361715 bus /gobi_4: Setting Powered False 23:36:38.477173 bus /gobi_1: Setting Powered False 23:36:39.576184 bus /gobi_1: Setting Powered False 23:36:40.688775 bus /gobi_0: Setting Powered False 23:36:41.786968 bus /gobi_0: Setting Powered False 23:36:42.903656 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:36:44.006477 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:44.018638 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:36:44.090670 tst ping.py: using LAC 37012 23:36:44.213973 tst ping.py: using RAC 37 23:36:44.335998 tst ping.py: using CellId 37012 23:36:44.460049 tst ping.py: using BVCI 37013 23:36:44.573424 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:44.584717 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:44.595919 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:44.607065 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:44.618545 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:44.630158 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:44.641745 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:44.653226 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:44.771195 tst ping.py:19: start network... 23:36:44.982984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:45.469507 run create_hlr_db(pid=13753): Launched 23:36:45.588608 bus /gobi_6: Setting Powered False 23:36:46.682822 run create_hlr_db(pid=13753): Terminated: ok {rc=0} 23:36:47.179141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13755): Launched 23:36:47.502601 run osmo-hlr_10.42.42.2(pid=13756): Launched 23:36:47.622960 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:48.167323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13758): Launched 23:36:48.480140 run osmo-stp_10.42.42.5(pid=13759): Launched 23:36:48.601261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:49.143207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13761): Launched 23:36:49.262858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:49.527852 run patchelf(pid=13762): Launched 23:36:49.702124 run osmo-stp_10.42.42.5(pid=13759): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13759)] 23:36:49.835578 run osmo-stp_10.42.42.5(pid=13759): stdout: | (launched: 2022-12-13_23:36:48.423256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:49.970421 run osmo-stp_10.42.42.5(pid=13759): stderr: | [0;m[38;5;43m20221213233648615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233648615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233648616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233648616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233648617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233648617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233648617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:50.105859 run osmo-stp_10.42.42.5(pid=13759): stdout: | (launched: 2022-12-13_23:36:48.423256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:50.235024 run osmo-stp_10.42.42.5(pid=13759): stderr: | [0;m[38;5;43m20221213233648615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233648615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233648616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233648616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233648617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233648617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233648617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:50.387926 run patchelf(pid=13762): Terminating (SIGINT) 23:36:50.564314 run patchelf(pid=13762): Terminated: ok {rc=0} 23:36:50.691355 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13759): Process ended prematurely: osmo-stp_10.42.42.5(pid=13759) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13759)] [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 23:36:50.700641 tst ping.py:22: Test FAILED (6.7 sec) 23:36:50.728739 run osmo-hlr_10.42.42.2(pid=13756): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13756)] 23:36:50.779927 run osmo-hlr_10.42.42.2(pid=13756): stdout: | (launched: 2022-12-13_23:36:47.446025) 23:36:50.832799 run osmo-hlr_10.42.42.2(pid=13756): stderr: | [0;m[1;31m20221213233647640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233647640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233647640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233647640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233647640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233647641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233647653 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233647661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233647661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233647661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:50.885448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13755): Terminating (SIGTERM) 23:36:50.927501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13758): Terminating (SIGTERM) 23:36:50.970218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13761): Terminating (SIGTERM) 23:36:51.013227 --- ParallelTerminationStrategy: PID 13755 died... 23:36:51.033621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13755): Terminated: ok {rc=0} 23:36:51.080472 --- ParallelTerminationStrategy: PID 13758 died... 23:36:51.100455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13758): Terminated: ok {rc=0} 23:36:51.146741 --- ParallelTerminationStrategy: PID 13761 died... 23:36:51.166622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13761): Terminated: ok {rc=0} 23:36:51.254163 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:36:52.341488 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:52.353393 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:36:52.425733 tst ping_idle_ping.py: using LAC 37013 23:36:52.542535 tst ping_idle_ping.py: using RAC 38 23:36:52.657294 tst ping_idle_ping.py: using CellId 37013 23:36:52.774431 tst ping_idle_ping.py: using BVCI 37014 23:36:52.881426 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:52.892560 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:52.903428 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:52.914380 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:52.925537 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:52.936552 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:52.947724 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:52.958796 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:53.076809 tst ping_idle_ping.py:24: start network... 23:36:53.290114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:53.784023 run create_hlr_db(pid=13763): Launched 23:36:53.903676 bus /gobi_6: Setting Powered False 23:36:54.965669 run create_hlr_db(pid=13763): Terminated: ok {rc=0} 23:36:55.387085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13765): Launched 23:36:55.680499 run osmo-hlr_10.42.42.2(pid=13766): Launched 23:36:55.792818 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:56.310325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13768): Launched 23:36:56.602479 run osmo-stp_10.42.42.5(pid=13769): Launched 23:36:56.715170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:57.220365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13771): Launched 23:36:57.332504 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:57.580255 run patchelf(pid=13772): Launched 23:36:57.743310 run osmo-stp_10.42.42.5(pid=13769): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13769)] 23:36:57.868265 run osmo-stp_10.42.42.5(pid=13769): stdout: | (launched: 2022-12-13_23:36:56.549094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:57.994723 run osmo-stp_10.42.42.5(pid=13769): stderr: | [0;m[38;5;43m20221213233656715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233656715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233656715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233656716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233656716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233656716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233656716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:58.120823 run osmo-stp_10.42.42.5(pid=13769): stdout: | (launched: 2022-12-13_23:36:56.549094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:58.242135 run osmo-stp_10.42.42.5(pid=13769): stderr: | [0;m[38;5;43m20221213233656715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233656715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233656715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233656716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233656716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233656716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233656716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:58.385529 run patchelf(pid=13772): Terminating (SIGINT) 23:36:58.549886 run patchelf(pid=13772): Terminated: ok {rc=0} 23:36:58.668836 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13769): Process ended prematurely: osmo-stp_10.42.42.5(pid=13769) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13769)] [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:36:58.677663 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 23:36:58.704036 run osmo-hlr_10.42.42.2(pid=13766): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13766)] 23:36:58.752054 run osmo-hlr_10.42.42.2(pid=13766): stdout: | (launched: 2022-12-13_23:36:55.627384) 23:36:58.801370 run osmo-hlr_10.42.42.2(pid=13766): stderr: | [0;m[1;31m20221213233655804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233655804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233655804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233655804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233655804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233655804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233655816 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233655826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233655827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233655827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:58.851010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13765): Terminating (SIGTERM) 23:36:58.890528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13768): Terminating (SIGTERM) 23:36:58.930825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13771): Terminating (SIGTERM) 23:36:58.970650 --- ParallelTerminationStrategy: PID 13765 died... 23:36:58.989860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13765): Terminated: ok {rc=0} 23:36:59.033662 --- ParallelTerminationStrategy: PID 13768 died... 23:36:59.052078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13768): Terminated: ok {rc=0} 23:36:59.095838 --- ParallelTerminationStrategy: PID 13771 died... 23:36:59.114443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13771): Terminated: ok {rc=0} 23:36:59.197923 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:37:00.506537 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:37:00.512873 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:37:00.545397 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:37:00.583659 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:37:00.669925 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:37:00.702721 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:37:00.740649 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:37:01.351833 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:37:01.401962 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:01.413515 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:37:01.482515 tst cs_paging_gprs_active.py: using LAC 37014 23:37:01.621823 tst cs_paging_gprs_active.py: using RAC 39 23:37:01.752613 tst cs_paging_gprs_active.py: using CellId 37014 23:37:01.887446 tst cs_paging_gprs_active.py: using BVCI 37015 23:37:02.000506 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:02.012376 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:02.024211 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:02.035947 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:02.048587 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:02.060837 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:02.072891 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:02.084895 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:02.097041 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:02.217368 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:02.336178 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:37:02.553653 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:02.875430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13777): Launched 23:37:03.155635 run iperf3-srv_10.42.42.10(pid=13778): Launched 23:37:03.275857 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:37:03.492078 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:03.813736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13779): Launched 23:37:04.092179 run iperf3-srv_10.42.42.10(pid=13780): Launched 23:37:04.211854 tst cs_paging_gprs_active.py:38: start network... 23:37:04.427786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:04.923145 run create_hlr_db(pid=13781): Launched 23:37:05.045450 bus /gobi_6: Setting Powered False 23:37:06.105649 run create_hlr_db(pid=13781): Terminated: ok {rc=0} 23:37:06.530687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13783): Launched 23:37:06.829690 run osmo-hlr_10.42.42.2(pid=13784): Launched 23:37:06.943845 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:07.472250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13786): Launched 23:37:07.770650 run osmo-stp_10.42.42.5(pid=13787): Launched 23:37:07.885055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:08.401329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13789): Launched 23:37:08.516408 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:08.770227 run patchelf(pid=13790): Launched 23:37:08.936028 run osmo-stp_10.42.42.5(pid=13787): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13787)] 23:37:09.062982 run osmo-stp_10.42.42.5(pid=13787): stdout: | (launched: 2022-12-13_23:37:07.716623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:09.191901 run osmo-stp_10.42.42.5(pid=13787): stderr: | [0;m[38;5;43m20221213233707887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233707887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233707887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233707888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233707888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233707888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233707888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:09.320573 run osmo-stp_10.42.42.5(pid=13787): stdout: | (launched: 2022-12-13_23:37:07.716623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:09.443627 run osmo-stp_10.42.42.5(pid=13787): stderr: | [0;m[38;5;43m20221213233707887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233707887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233707887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233707888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233707888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233707888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233707888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:09.589332 run patchelf(pid=13790): Terminating (SIGINT) 23:37:09.757620 run patchelf(pid=13790): Terminated: ok {rc=0} 23:37:09.879016 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13787): Process ended prematurely: osmo-stp_10.42.42.5(pid=13787) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13787)] [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:37:09.888326 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:37:09.915405 run osmo-hlr_10.42.42.2(pid=13784): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13784)] 23:37:09.963273 run osmo-hlr_10.42.42.2(pid=13784): stdout: | (launched: 2022-12-13_23:37:06.775672) 23:37:10.012668 run osmo-hlr_10.42.42.2(pid=13784): stderr: | [0;m[1;31m20221213233706950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233706950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233706950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233706950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233706950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233706950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233706962 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233706971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233706971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233706971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:10.062735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13777): Terminating (SIGTERM) 23:37:10.102948 run iperf3-srv_10.42.42.10(pid=13778): Terminating (SIGTERM) 23:37:10.142949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13779): Terminating (SIGTERM) 23:37:10.183050 run iperf3-srv_10.42.42.10(pid=13780): Terminating (SIGTERM) 23:37:10.222810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13783): Terminating (SIGTERM) 23:37:10.262793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13786): Terminating (SIGTERM) 23:37:10.302745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13789): Terminating (SIGTERM) 23:37:10.342870 --- ParallelTerminationStrategy: PID 13777 died... 23:37:10.362188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13777): Terminated: ok {rc=0} 23:37:10.406297 --- ParallelTerminationStrategy: PID 13778 died... 23:37:10.424888 run iperf3-srv_10.42.42.10(pid=13778): Terminated {rc=256} 23:37:10.468712 --- ParallelTerminationStrategy: PID 13779 died... 23:37:10.487331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13779): Terminated: ok {rc=0} 23:37:10.531308 --- ParallelTerminationStrategy: PID 13780 died... 23:37:10.550035 run iperf3-srv_10.42.42.10(pid=13780): Terminated {rc=256} 23:37:10.593769 --- ParallelTerminationStrategy: PID 13783 died... 23:37:10.612454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13783): Terminated: ok {rc=0} 23:37:10.656109 --- ParallelTerminationStrategy: PID 13786 died... 23:37:10.674790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13786): Terminated: ok {rc=0} 23:37:10.718444 --- ParallelTerminationStrategy: PID 13789 died... 23:37:10.736899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13789): Terminated: ok {rc=0} 23:37:10.820102 bus /gobi_0: Setting Powered False 23:37:11.915427 bus /gobi_0: Setting Powered False 23:37:13.031460 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:37:14.177536 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:14.188883 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:37:14.260436 tst iperf3.py: using LAC 37015 23:37:14.377031 tst iperf3.py: using RAC 40 23:37:14.493328 tst iperf3.py: using CellId 37015 23:37:14.609712 tst iperf3.py: using BVCI 37016 23:37:14.717440 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:14.728129 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:14.738705 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:14.749302 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:14.759754 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:14.770919 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:14.782305 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:14.792806 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:14.803800 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:14.918672 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:37:15.119694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:15.419150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13791): Launched 23:37:15.678384 run iperf3-srv_10.42.42.10(pid=13792): Launched 23:37:15.790297 tst iperf3.py:8: start network... 23:37:16.004712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:16.485663 run create_hlr_db(pid=13793): Launched 23:37:16.632006 bus /gobi_6: Setting Powered False 23:37:17.692079 run create_hlr_db(pid=13793): Terminated: ok {rc=0} 23:37:18.127656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13795): Launched 23:37:18.446655 run osmo-hlr_10.42.42.2(pid=13796): Launched 23:37:18.569411 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:19.123653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13798): Launched 23:37:19.441425 run osmo-stp_10.42.42.5(pid=13799): Launched 23:37:19.563335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:20.115467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13802): Launched 23:37:20.236940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:20.506291 run patchelf(pid=13803): Launched 23:37:20.683172 run osmo-stp_10.42.42.5(pid=13799): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13799)] 23:37:20.818370 run osmo-stp_10.42.42.5(pid=13799): stdout: | (launched: 2022-12-13_23:37:19.383655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:20.955614 run osmo-stp_10.42.42.5(pid=13799): stderr: | [0;m[38;5;43m20221213233719576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233719576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233719576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233719577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233719577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233719577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233719577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:21.093294 run osmo-stp_10.42.42.5(pid=13799): stdout: | (launched: 2022-12-13_23:37:19.383655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:21.224027 run osmo-stp_10.42.42.5(pid=13799): stderr: | [0;m[38;5;43m20221213233719576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233719576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233719576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233719577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233719577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233719577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233719577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:21.379377 run patchelf(pid=13803): Terminating (SIGINT) 23:37:21.559273 run patchelf(pid=13803): Terminated: ok {rc=0} 23:37:21.688742 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13799): Process ended prematurely: osmo-stp_10.42.42.5(pid=13799) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13799)] [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 23:37:21.698931 tst iperf3.py:8: Test FAILED (7.6 sec) 23:37:21.727377 run osmo-hlr_10.42.42.2(pid=13796): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13796)] 23:37:21.778270 run osmo-hlr_10.42.42.2(pid=13796): stdout: | (launched: 2022-12-13_23:37:18.388923) 23:37:21.830484 run osmo-hlr_10.42.42.2(pid=13796): stderr: | [0;m[1;31m20221213233718586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233718586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233718586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233718586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233718586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233718586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233718598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233718606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233718606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233718606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:21.883219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13791): Terminating (SIGTERM) 23:37:21.924931 run iperf3-srv_10.42.42.10(pid=13792): Terminating (SIGTERM) 23:37:21.967694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13795): Terminating (SIGTERM) 23:37:22.010680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13798): Terminating (SIGTERM) 23:37:22.053009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13802): Terminating (SIGTERM) 23:37:22.095943 --- ParallelTerminationStrategy: PID 13791 died... 23:37:22.116246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13791): Terminated: ok {rc=0} 23:37:22.162610 --- ParallelTerminationStrategy: PID 13792 died... 23:37:22.182325 run iperf3-srv_10.42.42.10(pid=13792): Terminated {rc=256} 23:37:22.228126 --- ParallelTerminationStrategy: PID 13795 died... 23:37:22.247865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13795): Terminated: ok {rc=0} 23:37:22.294055 --- ParallelTerminationStrategy: PID 13798 died... 23:37:22.313966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13798): Terminated: ok {rc=0} 23:37:22.359984 --- ParallelTerminationStrategy: PID 13802 died... 23:37:22.379718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13802): Terminated: ok {rc=0} 23:37:22.467409 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:37:23.617128 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:23.629199 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:37:23.702300 tst iperf3m4.py: using LAC 37016 23:37:23.828765 tst iperf3m4.py: using RAC 41 23:37:23.956577 tst iperf3m4.py: using CellId 37016 23:37:24.082540 tst iperf3m4.py: using BVCI 37017 23:37:24.191769 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:24.202896 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:24.213864 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:24.224694 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:24.235752 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:24.246682 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:24.257458 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:24.268061 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:24.278929 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:24.398506 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:24.518442 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:24.638184 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:24.754819 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:37:24.972293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:25.293560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13805): Launched 23:37:25.571256 run iperf3-srv_10.42.42.10(pid=13806): Launched 23:37:25.691346 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:37:25.907664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:26.228426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13807): Launched 23:37:26.505362 run iperf3-srv_10.42.42.10(pid=13808): Launched 23:37:26.625341 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:37:26.840866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:27.161546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13809): Launched 23:37:27.438116 run iperf3-srv_10.42.42.10(pid=13810): Launched 23:37:27.557671 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:37:27.773228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:28.093331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13811): Launched 23:37:28.370458 run iperf3-srv_10.42.42.10(pid=13812): Launched 23:37:28.490222 tst iperf3m4.py:8: start network... 23:37:28.705445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:29.200119 run create_hlr_db(pid=13813): Launched 23:37:29.322431 bus /gobi_6: Setting Powered False 23:37:30.382266 run create_hlr_db(pid=13813): Terminated: ok {rc=0} 23:37:30.818082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13815): Launched 23:37:31.166976 run osmo-hlr_10.42.42.2(pid=13816): Launched 23:37:31.289012 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:32.105508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13818): Launched 23:37:32.487090 run osmo-stp_10.42.42.5(pid=13819): Launched 23:37:32.613519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:33.165128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13821): Launched 23:37:33.286821 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:33.555661 run patchelf(pid=13822): Launched 23:37:33.732675 run osmo-stp_10.42.42.5(pid=13819): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13819)] 23:37:33.867766 run osmo-stp_10.42.42.5(pid=13819): stdout: | (launched: 2022-12-13_23:37:32.426200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:34.004111 run osmo-stp_10.42.42.5(pid=13819): stderr: | [0;m[38;5;43m20221213233732628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233732628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233732628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233732629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233732629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233732629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233732629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:34.141491 run osmo-stp_10.42.42.5(pid=13819): stdout: | (launched: 2022-12-13_23:37:32.426200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:34.272056 run osmo-stp_10.42.42.5(pid=13819): stderr: | [0;m[38;5;43m20221213233732628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233732628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233732628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233732629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233732629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233732629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233732629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:34.427161 run patchelf(pid=13822): Terminating (SIGINT) 23:37:34.605602 run patchelf(pid=13822): Terminated: ok {rc=0} 23:37:34.733992 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13819): Process ended prematurely: osmo-stp_10.42.42.5(pid=13819) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13819)] [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:37:34.744047 tst iperf3m4.py:8: Test FAILED (11.2 sec) 23:37:34.772344 run osmo-hlr_10.42.42.2(pid=13816): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13816)] 23:37:34.822481 run osmo-hlr_10.42.42.2(pid=13816): stdout: | (launched: 2022-12-13_23:37:31.100834) 23:37:34.873984 run osmo-hlr_10.42.42.2(pid=13816): stderr: | [0;m[1;31m20221213233731536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233731536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233731536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233731536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233731536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233731536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233731565 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233731588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233731594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233731594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:34.925874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13805): Terminating (SIGTERM) 23:37:34.967385 run iperf3-srv_10.42.42.10(pid=13806): Terminating (SIGTERM) 23:37:35.010058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13807): Terminating (SIGTERM) 23:37:35.051774 run iperf3-srv_10.42.42.10(pid=13808): Terminating (SIGTERM) 23:37:35.093418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13809): Terminating (SIGTERM) 23:37:35.134953 run iperf3-srv_10.42.42.10(pid=13810): Terminating (SIGTERM) 23:37:35.177071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13811): Terminating (SIGTERM) 23:37:35.218897 run iperf3-srv_10.42.42.10(pid=13812): Terminating (SIGTERM) 23:37:35.260432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13815): Terminating (SIGTERM) 23:37:35.302309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13818): Terminating (SIGTERM) 23:37:35.343950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13821): Terminating (SIGTERM) 23:37:35.385895 --- ParallelTerminationStrategy: PID 13805 died... 23:37:35.405731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13805): Terminated: ok {rc=0} 23:37:35.451953 --- ParallelTerminationStrategy: PID 13806 died... 23:37:35.471639 run iperf3-srv_10.42.42.10(pid=13806): Terminated {rc=256} 23:37:35.518042 --- ParallelTerminationStrategy: PID 13807 died... 23:37:35.537834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13807): Terminated: ok {rc=0} 23:37:35.583982 --- ParallelTerminationStrategy: PID 13808 died... 23:37:35.603662 run iperf3-srv_10.42.42.10(pid=13808): Terminated {rc=256} 23:37:35.649727 --- ParallelTerminationStrategy: PID 13809 died... 23:37:35.669658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13809): Terminated: ok {rc=0} 23:37:35.715777 --- ParallelTerminationStrategy: PID 13810 died... 23:37:35.735541 run iperf3-srv_10.42.42.10(pid=13810): Terminated {rc=256} 23:37:35.781896 --- ParallelTerminationStrategy: PID 13811 died... 23:37:35.801660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13811): Terminated: ok {rc=0} 23:37:35.847821 --- ParallelTerminationStrategy: PID 13812 died... 23:37:35.867417 run iperf3-srv_10.42.42.10(pid=13812): Terminated {rc=256} 23:37:35.913474 --- ParallelTerminationStrategy: PID 13815 died... 23:37:35.933271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13815): Terminated: ok {rc=0} 23:37:35.979477 --- ParallelTerminationStrategy: PID 13818 died... 23:37:35.999325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13818): Terminated: ok {rc=0} 23:37:36.045803 --- ParallelTerminationStrategy: PID 13821 died... 23:37:36.065817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13821): Terminated: ok {rc=0} 23:37:36.154165 bus /gobi_4: Setting Powered False 23:37:37.253252 bus /gobi_4: Setting Powered False 23:37:38.368684 bus /gobi_1: Setting Powered False 23:37:39.466778 bus /gobi_1: Setting Powered False 23:37:40.580924 bus /gobi_0: Setting Powered False 23:37:41.678691 bus /gobi_0: Setting Powered False 23:37:42.795387 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:37:43.897514 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:43.909492 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:37:43.980361 tst ping.py: using LAC 37017 23:37:44.102123 tst ping.py: using RAC 42 23:37:44.225244 tst ping.py: using CellId 37017 23:37:44.346309 tst ping.py: using BVCI 37018 23:37:44.460222 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:44.471641 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:44.482859 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:44.494124 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:44.505584 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:44.516840 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:44.528448 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:44.540063 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:44.658142 tst ping.py:19: start network... 23:37:44.869208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:45.354263 run create_hlr_db(pid=13823): Launched 23:37:45.472781 bus /gobi_6: Setting Powered False 23:37:46.533101 run create_hlr_db(pid=13823): Terminated: ok {rc=0} 23:37:46.989709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13825): Launched 23:37:47.310035 run osmo-hlr_10.42.42.2(pid=13826): Launched 23:37:47.432019 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:47.981018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13828): Launched 23:37:48.294015 run osmo-stp_10.42.42.5(pid=13829): Launched 23:37:48.412827 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:48.951899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13831): Launched 23:37:49.072465 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:49.336900 run patchelf(pid=13832): Launched 23:37:49.511067 run osmo-stp_10.42.42.5(pid=13829): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13829)] 23:37:49.643845 run osmo-stp_10.42.42.5(pid=13829): stdout: | (launched: 2022-12-13_23:37:48.237544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:49.778249 run osmo-stp_10.42.42.5(pid=13829): stderr: | [0;m[38;5;43m20221213233748429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233748430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233748430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233748430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233748431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233748431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233748431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:49.912490 run osmo-stp_10.42.42.5(pid=13829): stdout: | (launched: 2022-12-13_23:37:48.237544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:50.041606 run osmo-stp_10.42.42.5(pid=13829): stderr: | [0;m[38;5;43m20221213233748429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233748430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233748430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233748430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233748431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233748431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233748431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:50.194240 run patchelf(pid=13832): Terminating (SIGINT) 23:37:50.370102 run patchelf(pid=13832): Terminated: ok {rc=0} 23:37:50.496372 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13829): Process ended prematurely: osmo-stp_10.42.42.5(pid=13829) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13829)] [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 23:37:50.505931 tst ping.py:22: Test FAILED (6.6 sec) 23:37:50.533651 run osmo-hlr_10.42.42.2(pid=13826): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13826)] 23:37:50.584090 run osmo-hlr_10.42.42.2(pid=13826): stdout: | (launched: 2022-12-13_23:37:47.253542) 23:37:50.636523 run osmo-hlr_10.42.42.2(pid=13826): stderr: | [0;m[1;31m20221213233747448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233747448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233747448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233747448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233747448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233747448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233747461 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233747470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233747470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233747470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:50.688739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13825): Terminating (SIGTERM) 23:37:50.730584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13828): Terminating (SIGTERM) 23:37:50.772791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13831): Terminating (SIGTERM) 23:37:50.814870 --- ParallelTerminationStrategy: PID 13825 died... 23:37:50.835186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13825): Terminated: ok {rc=0} 23:37:50.881727 --- ParallelTerminationStrategy: PID 13828 died... 23:37:50.901442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13828): Terminated: ok {rc=0} 23:37:50.947647 --- ParallelTerminationStrategy: PID 13831 died... 23:37:50.967372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13831): Terminated: ok {rc=0} 23:37:51.055311 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:37:52.139520 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:52.151658 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:37:52.222708 tst ping_idle_ping.py: using LAC 37018 23:37:52.340713 tst ping_idle_ping.py: using RAC 43 23:37:52.457552 tst ping_idle_ping.py: using CellId 37018 23:37:52.592051 tst ping_idle_ping.py: using BVCI 37019 23:37:52.707922 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:52.719248 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:52.730388 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:52.741579 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:52.752858 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:52.764267 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:52.775718 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:52.787126 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:52.904304 tst ping_idle_ping.py:24: start network... 23:37:53.117740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:53.607460 run create_hlr_db(pid=13833): Launched 23:37:53.726615 bus /gobi_6: Setting Powered False 23:37:54.788853 run create_hlr_db(pid=13833): Terminated: ok {rc=0} 23:37:55.211449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13835): Launched 23:37:55.504069 run osmo-hlr_10.42.42.2(pid=13836): Launched 23:37:55.616823 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:56.122665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13838): Launched 23:37:56.416370 run osmo-stp_10.42.42.5(pid=13839): Launched 23:37:56.528469 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:57.035259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13841): Launched 23:37:57.148044 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:57.396532 run patchelf(pid=13842): Launched 23:37:57.560069 run osmo-stp_10.42.42.5(pid=13839): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13839)] 23:37:57.684878 run osmo-stp_10.42.42.5(pid=13839): stdout: | (launched: 2022-12-13_23:37:56.362864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:57.811427 run osmo-stp_10.42.42.5(pid=13839): stderr: | [0;m[38;5;43m20221213233756532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233756532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233756532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233756532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233756533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233756533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233756533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:57.937466 run osmo-stp_10.42.42.5(pid=13839): stdout: | (launched: 2022-12-13_23:37:56.362864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:58.058608 run osmo-stp_10.42.42.5(pid=13839): stderr: | [0;m[38;5;43m20221213233756532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233756532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233756532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233756532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233756533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233756533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233756533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:58.201767 run patchelf(pid=13842): Terminating (SIGINT) 23:37:58.368517 run patchelf(pid=13842): Terminated: ok {rc=0} 23:37:58.487631 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13839): Process ended prematurely: osmo-stp_10.42.42.5(pid=13839) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13839)] [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:37:58.496302 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 23:37:58.522903 run osmo-hlr_10.42.42.2(pid=13836): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13836)] 23:37:58.570466 run osmo-hlr_10.42.42.2(pid=13836): stdout: | (launched: 2022-12-13_23:37:55.450990) 23:37:58.619364 run osmo-hlr_10.42.42.2(pid=13836): stderr: | [0;m[1;31m20221213233755626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233755626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233755626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233755626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233755626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233755626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233755638 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233755649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233755649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233755649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:58.668922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13835): Terminating (SIGTERM) 23:37:58.708150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13838): Terminating (SIGTERM) 23:37:58.747416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13841): Terminating (SIGTERM) 23:37:58.787021 --- ParallelTerminationStrategy: PID 13835 died... 23:37:58.806066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13835): Terminated: ok {rc=0} 23:37:58.849878 --- ParallelTerminationStrategy: PID 13838 died... 23:37:58.868373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13838): Terminated: ok {rc=0} 23:37:58.912384 --- ParallelTerminationStrategy: PID 13841 died... 23:37:58.931212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13841): Terminated: ok {rc=0} 23:37:59.017081 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:38:00.320780 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:38:00.326768 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:38:00.359173 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 23:38:00.397269 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 23:38:00.482573 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:38:00.515107 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 23:38:00.553099 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 23:38:01.170735 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 23:38:01.235885 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:01.249954 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:38:01.309656 tst cs_paging_gprs_active.py: using LAC 37019 23:38:01.469105 tst cs_paging_gprs_active.py: using RAC 44 23:38:01.599344 tst cs_paging_gprs_active.py: using CellId 37019 23:38:01.722403 tst cs_paging_gprs_active.py: using BVCI 37020 23:38:01.833146 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:01.845865 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:01.858068 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:01.870120 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:01.883345 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:01.895415 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:01.906995 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:01.919105 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:01.930876 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:02.049792 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:02.170339 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:38:02.388744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:02.691422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13846): Launched 23:38:02.952890 run iperf3-srv_10.42.42.10(pid=13847): Launched 23:38:03.065828 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:38:03.268735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:03.571459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13848): Launched 23:38:03.831468 run iperf3-srv_10.42.42.10(pid=13849): Launched 23:38:03.943255 tst cs_paging_gprs_active.py:38: start network... 23:38:04.143936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:04.607481 run create_hlr_db(pid=13850): Launched 23:38:04.730250 bus /gobi_6: Setting Powered False 23:38:05.790484 run create_hlr_db(pid=13850): Terminated: ok {rc=0} 23:38:06.206954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13852): Launched 23:38:06.505557 run osmo-hlr_10.42.42.2(pid=13853): Launched 23:38:06.618816 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:07.146593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13855): Launched 23:38:07.447155 run osmo-stp_10.42.42.5(pid=13856): Launched 23:38:07.561025 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:08.077499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13858): Launched 23:38:08.191775 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:08.444201 run patchelf(pid=13859): Launched 23:38:08.610002 run osmo-stp_10.42.42.5(pid=13856): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13856)] 23:38:08.736507 run osmo-stp_10.42.42.5(pid=13856): stdout: | (launched: 2022-12-13_23:38:07.391840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:08.864794 run osmo-stp_10.42.42.5(pid=13856): stderr: | [0;m[38;5;43m20221213233807563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233807563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233807563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233807564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233807564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233807565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233807565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:08.993265 run osmo-stp_10.42.42.5(pid=13856): stdout: | (launched: 2022-12-13_23:38:07.391840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:09.115976 run osmo-stp_10.42.42.5(pid=13856): stderr: | [0;m[38;5;43m20221213233807563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233807563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233807563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233807564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233807564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233807565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233807565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:09.262301 run patchelf(pid=13859): Terminating (SIGINT) 23:38:09.429860 run patchelf(pid=13859): Terminated: ok {rc=0} 23:38:09.550175 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13856): Process ended prematurely: osmo-stp_10.42.42.5(pid=13856) [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13856)] [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 23:38:09.559422 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 23:38:09.586339 run osmo-hlr_10.42.42.2(pid=13853): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13853)] 23:38:09.633548 run osmo-hlr_10.42.42.2(pid=13853): stdout: | (launched: 2022-12-13_23:38:06.450997) 23:38:09.682868 run osmo-hlr_10.42.42.2(pid=13853): stderr: | [0;m[1;31m20221213233806627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233806627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233806627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233806627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233806627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233806627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233806639 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233806650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233806650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233806650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:09.732388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13846): Terminating (SIGTERM) 23:38:09.772009 run iperf3-srv_10.42.42.10(pid=13847): Terminating (SIGTERM) 23:38:09.811443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13848): Terminating (SIGTERM) 23:38:09.850932 run iperf3-srv_10.42.42.10(pid=13849): Terminating (SIGTERM) 23:38:09.890266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13852): Terminating (SIGTERM) 23:38:09.929723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13855): Terminating (SIGTERM) 23:38:09.969244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13858): Terminating (SIGTERM) 23:38:10.009201 --- ParallelTerminationStrategy: PID 13846 died... 23:38:10.028142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13846): Terminated: ok {rc=0} 23:38:10.071886 --- ParallelTerminationStrategy: PID 13847 died... 23:38:10.090441 run iperf3-srv_10.42.42.10(pid=13847): Terminated {rc=256} 23:38:10.134070 --- ParallelTerminationStrategy: PID 13848 died... 23:38:10.152688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13848): Terminated: ok {rc=0} 23:38:10.196089 --- ParallelTerminationStrategy: PID 13849 died... 23:38:10.214549 run iperf3-srv_10.42.42.10(pid=13849): Terminated {rc=256} 23:38:10.258011 --- ParallelTerminationStrategy: PID 13852 died... 23:38:10.276437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13852): Terminated: ok {rc=0} 23:38:10.320132 --- ParallelTerminationStrategy: PID 13855 died... 23:38:10.338756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13855): Terminated: ok {rc=0} 23:38:10.382610 --- ParallelTerminationStrategy: PID 13858 died... 23:38:10.401323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13858): Terminated: ok {rc=0} 23:38:10.484547 bus /gobi_0: Setting Powered False 23:38:11.580164 bus /gobi_0: Setting Powered False 23:38:12.695447 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 23:38:13.845303 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:13.857773 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:38:13.914134 tst iperf3.py: using LAC 37020 23:38:14.042257 tst iperf3.py: using RAC 45 23:38:14.167453 tst iperf3.py: using CellId 37020 23:38:14.287484 tst iperf3.py: using BVCI 37021 23:38:14.396122 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:14.407318 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:14.418543 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:14.429556 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:14.440383 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:14.451339 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:14.462600 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:14.473950 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:14.484887 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:14.604193 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:38:14.819863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:15.139671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13860): Launched 23:38:15.417470 run iperf3-srv_10.42.42.10(pid=13861): Launched 23:38:15.537125 tst iperf3.py:8: start network... 23:38:15.752690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:16.278959 run create_hlr_db(pid=13862): Launched 23:38:16.441361 bus /gobi_6: Setting Powered False 23:38:17.504564 run create_hlr_db(pid=13862): Terminated: ok {rc=0} 23:38:17.948190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13864): Launched 23:38:18.267024 run osmo-hlr_10.42.42.2(pid=13865): Launched 23:38:18.389270 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:18.941502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13867): Launched 23:38:19.259558 run osmo-stp_10.42.42.5(pid=13868): Launched 23:38:19.381652 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:19.930473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13870): Launched 23:38:20.053197 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:20.322640 run patchelf(pid=13871): Launched 23:38:20.499886 run osmo-stp_10.42.42.5(pid=13868): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13868)] 23:38:20.635535 run osmo-stp_10.42.42.5(pid=13868): stdout: | (launched: 2022-12-13_23:38:19.202199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:20.772802 run osmo-stp_10.42.42.5(pid=13868): stderr: | [0;m[38;5;43m20221213233819394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233819394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233819394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233819395 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233819395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233819395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233819395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:20.910113 run osmo-stp_10.42.42.5(pid=13868): stdout: | (launched: 2022-12-13_23:38:19.202199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:21.041588 run osmo-stp_10.42.42.5(pid=13868): stderr: | [0;m[38;5;43m20221213233819394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233819394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233819394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233819395 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233819395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233819395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233819395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:21.197218 run patchelf(pid=13871): Terminating (SIGINT) 23:38:21.377169 run patchelf(pid=13871): Terminated: ok {rc=0} 23:38:21.506771 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13868): Process ended prematurely: osmo-stp_10.42.42.5(pid=13868) [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13868)] [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 23:38:21.516848 tst iperf3.py:8: Test FAILED (7.7 sec) 23:38:21.545410 run osmo-hlr_10.42.42.2(pid=13865): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13865)] 23:38:21.595841 run osmo-hlr_10.42.42.2(pid=13865): stdout: | (launched: 2022-12-13_23:38:18.209416) 23:38:21.647400 run osmo-hlr_10.42.42.2(pid=13865): stderr: | [0;m[1;31m20221213233818407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233818407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233818407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233818407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233818407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233818407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233818420 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233818430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233818430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233818430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:21.699452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13860): Terminating (SIGTERM) 23:38:21.741258 run iperf3-srv_10.42.42.10(pid=13861): Terminating (SIGTERM) 23:38:21.782783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13864): Terminating (SIGTERM) 23:38:21.825042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13867): Terminating (SIGTERM) 23:38:21.866947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13870): Terminating (SIGTERM) 23:38:21.909477 --- ParallelTerminationStrategy: PID 13860 died... 23:38:21.929825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13860): Terminated: ok {rc=0} 23:38:21.975902 --- ParallelTerminationStrategy: PID 13861 died... 23:38:21.995512 run iperf3-srv_10.42.42.10(pid=13861): Terminated {rc=256} 23:38:22.041879 --- ParallelTerminationStrategy: PID 13864 died... 23:38:22.061602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13864): Terminated: ok {rc=0} 23:38:22.107620 --- ParallelTerminationStrategy: PID 13867 died... 23:38:22.127505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13867): Terminated: ok {rc=0} 23:38:22.173266 --- ParallelTerminationStrategy: PID 13870 died... 23:38:22.193047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13870): Terminated: ok {rc=0} 23:38:22.280374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 23:38:23.433228 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:23.445423 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:38:23.497720 tst iperf3m4.py: using LAC 37021 23:38:23.616930 tst iperf3m4.py: using RAC 46 23:38:23.734451 tst iperf3m4.py: using CellId 37021 23:38:23.853665 tst iperf3m4.py: using BVCI 37022 23:38:23.964754 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:23.976222 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:23.987518 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:23.998742 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:24.010377 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:24.021995 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:24.033739 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:24.045188 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:24.056719 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:24.178567 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:24.300018 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:24.418158 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:24.533454 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:38:24.734465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:25.037752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13872): Launched 23:38:25.315279 run iperf3-srv_10.42.42.10(pid=13873): Launched 23:38:25.435676 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:38:25.652320 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:25.973096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13874): Launched 23:38:26.251583 run iperf3-srv_10.42.42.10(pid=13875): Launched 23:38:26.371213 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:38:26.586960 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:26.908062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13876): Launched 23:38:27.186076 run iperf3-srv_10.42.42.10(pid=13877): Launched 23:38:27.305992 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:38:27.522366 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:27.843774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13878): Launched 23:38:28.121628 run iperf3-srv_10.42.42.10(pid=13879): Launched 23:38:28.241272 tst iperf3m4.py:8: start network... 23:38:28.456405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:28.950209 run create_hlr_db(pid=13880): Launched 23:38:29.071699 bus /gobi_6: Setting Powered False 23:38:30.135919 run create_hlr_db(pid=13880): Terminated: ok {rc=0} 23:38:30.579722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13882): Launched 23:38:30.917056 run osmo-hlr_10.42.42.2(pid=13883): Launched 23:38:31.154191 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:31.851789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13885): Launched 23:38:32.171600 run osmo-stp_10.42.42.5(pid=13886): Launched 23:38:32.388304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:32.936730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13888): Launched 23:38:33.059018 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:33.327971 run patchelf(pid=13889): Launched 23:38:33.505474 run osmo-stp_10.42.42.5(pid=13886): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13886)] 23:38:33.640644 run osmo-stp_10.42.42.5(pid=13886): stdout: | (launched: 2022-12-13_23:38:32.108905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:33.777622 run osmo-stp_10.42.42.5(pid=13886): stderr: | [0;m[38;5;43m20221213233832314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233832314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233832315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233832315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233832315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233832315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233832316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:33.914654 run osmo-stp_10.42.42.5(pid=13886): stdout: | (launched: 2022-12-13_23:38:32.108905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:34.046053 run osmo-stp_10.42.42.5(pid=13886): stderr: | [0;m[38;5;43m20221213233832314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233832314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233832315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233832315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233832315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233832315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233832316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:34.201588 run patchelf(pid=13889): Terminating (SIGINT) 23:38:34.380781 run patchelf(pid=13889): Terminated: ok {rc=0} 23:38:34.509652 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13886): Process ended prematurely: osmo-stp_10.42.42.5(pid=13886) [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13886)] [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 23:38:34.519825 tst iperf3m4.py:8: Test FAILED (11.1 sec) 23:38:34.548374 run osmo-hlr_10.42.42.2(pid=13883): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13883)] 23:38:34.598609 run osmo-hlr_10.42.42.2(pid=13883): stdout: | (launched: 2022-12-13_23:38:30.843714) 23:38:34.650553 run osmo-hlr_10.42.42.2(pid=13883): stderr: | [0;m[1;31m20221213233831205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233831205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233831205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233831205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233831206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233831206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233831219 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233831230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233831230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233831230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:34.702369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13872): Terminating (SIGTERM) 23:38:34.744042 run iperf3-srv_10.42.42.10(pid=13873): Terminating (SIGTERM) 23:38:34.785700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13874): Terminating (SIGTERM) 23:38:34.827393 run iperf3-srv_10.42.42.10(pid=13875): Terminating (SIGTERM) 23:38:34.868914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13876): Terminating (SIGTERM) 23:38:34.910752 run iperf3-srv_10.42.42.10(pid=13877): Terminating (SIGTERM) 23:38:34.952256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13878): Terminating (SIGTERM) 23:38:34.994087 run iperf3-srv_10.42.42.10(pid=13879): Terminating (SIGTERM) 23:38:35.035407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13882): Terminating (SIGTERM) 23:38:35.077719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13885): Terminating (SIGTERM) 23:38:35.119903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13888): Terminating (SIGTERM) 23:38:35.161752 --- ParallelTerminationStrategy: PID 13872 died... 23:38:35.181828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13872): Terminated: ok {rc=0} 23:38:35.227772 --- ParallelTerminationStrategy: PID 13873 died... 23:38:35.247409 run iperf3-srv_10.42.42.10(pid=13873): Terminated {rc=256} 23:38:35.293149 --- ParallelTerminationStrategy: PID 13874 died... 23:38:35.312799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13874): Terminated: ok {rc=0} 23:38:35.359055 --- ParallelTerminationStrategy: PID 13875 died... 23:38:35.378885 run iperf3-srv_10.42.42.10(pid=13875): Terminated {rc=256} 23:38:35.425076 --- ParallelTerminationStrategy: PID 13876 died... 23:38:35.445016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13876): Terminated: ok {rc=0} 23:38:35.491286 --- ParallelTerminationStrategy: PID 13877 died... 23:38:35.511102 run iperf3-srv_10.42.42.10(pid=13877): Terminated {rc=256} 23:38:35.557316 --- ParallelTerminationStrategy: PID 13878 died... 23:38:35.576922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13878): Terminated: ok {rc=0} 23:38:35.623605 --- ParallelTerminationStrategy: PID 13879 died... 23:38:35.643421 run iperf3-srv_10.42.42.10(pid=13879): Terminated {rc=256} 23:38:35.689521 --- ParallelTerminationStrategy: PID 13882 died... 23:38:35.709380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13882): Terminated: ok {rc=0} 23:38:35.755544 --- ParallelTerminationStrategy: PID 13885 died... 23:38:35.775454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13885): Terminated: ok {rc=0} 23:38:35.821539 --- ParallelTerminationStrategy: PID 13888 died... 23:38:35.841237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13888): Terminated: ok {rc=0} 23:38:35.929489 bus /gobi_4: Setting Powered False 23:38:37.027547 bus /gobi_4: Setting Powered False 23:38:38.145654 bus /gobi_1: Setting Powered False 23:38:39.243700 bus /gobi_1: Setting Powered False 23:38:40.361389 bus /gobi_0: Setting Powered False 23:38:41.459456 bus /gobi_0: Setting Powered False 23:38:42.574941 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 23:38:43.678160 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:43.690389 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:38:43.744427 tst ping.py: using LAC 37022 23:38:43.868731 tst ping.py: using RAC 47 23:38:43.990840 tst ping.py: using CellId 37022 23:38:44.113386 tst ping.py: using BVCI 37023 23:38:44.227023 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:44.238815 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:44.250553 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:44.262133 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:44.273969 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:44.285777 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:44.297717 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:44.309561 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:44.427938 tst ping.py:19: start network... 23:38:44.639160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:45.124067 run create_hlr_db(pid=13890): Launched 23:38:45.242897 bus /gobi_6: Setting Powered False 23:38:46.304386 run create_hlr_db(pid=13890): Terminated: ok {rc=0} 23:38:46.761836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13892): Launched 23:38:47.089726 run osmo-hlr_10.42.42.2(pid=13893): Launched 23:38:47.279496 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:47.821211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13895): Launched 23:38:48.133597 run osmo-stp_10.42.42.5(pid=13896): Launched 23:38:48.253420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:48.795972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13898): Launched 23:38:48.916613 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:49.182269 run patchelf(pid=13899): Launched 23:38:49.356332 run osmo-stp_10.42.42.5(pid=13896): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13896)] 23:38:49.489669 run osmo-stp_10.42.42.5(pid=13896): stdout: | (launched: 2022-12-13_23:38:48.076809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:49.624659 run osmo-stp_10.42.42.5(pid=13896): stderr: | [0;m[38;5;43m20221213233848266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233848266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233848267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233848267 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233848267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233848267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233848268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:49.759467 run osmo-stp_10.42.42.5(pid=13896): stdout: | (launched: 2022-12-13_23:38:48.076809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:49.888640 run osmo-stp_10.42.42.5(pid=13896): stderr: | [0;m[38;5;43m20221213233848266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233848266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233848267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233848267 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233848267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233848267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233848268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:50.041798 run patchelf(pid=13899): Terminating (SIGINT) 23:38:50.218629 run patchelf(pid=13899): Terminated: ok {rc=0} 23:38:50.345510 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13896): Process ended prematurely: osmo-stp_10.42.42.5(pid=13896) [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13896)] [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 23:38:50.355061 tst ping.py:22: Test FAILED (6.7 sec) 23:38:50.383078 run osmo-hlr_10.42.42.2(pid=13893): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13893)] 23:38:50.433510 run osmo-hlr_10.42.42.2(pid=13893): stdout: | (launched: 2022-12-13_23:38:47.021114) 23:38:50.485283 run osmo-hlr_10.42.42.2(pid=13893): stderr: | [0;m[1;31m20221213233847224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233847224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233847224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233847224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233847224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233847225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233847244 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233847254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233847254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233847254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:50.537483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13892): Terminating (SIGTERM) 23:38:50.579465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13895): Terminating (SIGTERM) 23:38:50.622178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13898): Terminating (SIGTERM) 23:38:50.664301 --- ParallelTerminationStrategy: PID 13892 died... 23:38:50.684709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13892): Terminated: ok {rc=0} 23:38:50.731069 --- ParallelTerminationStrategy: PID 13895 died... 23:38:50.750920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13895): Terminated: ok {rc=0} 23:38:50.797551 --- ParallelTerminationStrategy: PID 13898 died... 23:38:50.817535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13898): Terminated: ok {rc=0} 23:38:50.906237 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 23:38:51.991733 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:52.004309 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:38:52.057372 tst ping_idle_ping.py: using LAC 37023 23:38:52.175084 tst ping_idle_ping.py: using RAC 48 23:38:52.293075 tst ping_idle_ping.py: using CellId 37023 23:38:52.409566 tst ping_idle_ping.py: using BVCI 37024 23:38:52.516772 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:52.528330 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:52.539718 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:52.550784 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:52.562616 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:52.574348 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:52.586177 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:52.598026 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:52.716507 tst ping_idle_ping.py:24: start network... 23:38:52.930232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:53.419337 run create_hlr_db(pid=13901): Launched 23:38:53.539487 bus /gobi_6: Setting Powered False 23:38:54.601987 run create_hlr_db(pid=13901): Terminated: ok {rc=0} 23:38:55.040268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13903): Launched 23:38:55.354475 run osmo-hlr_10.42.42.2(pid=13904): Launched 23:38:55.473876 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:56.015899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13906): Launched 23:38:56.330649 run osmo-stp_10.42.42.5(pid=13907): Launched 23:38:56.451367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:56.995062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13909): Launched 23:38:57.115309 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:57.380662 run patchelf(pid=13910): Launched 23:38:57.555542 run osmo-stp_10.42.42.5(pid=13907): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13907)] 23:38:57.689445 run osmo-stp_10.42.42.5(pid=13907): stdout: | (launched: 2022-12-13_23:38:56.273511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:57.824234 run osmo-stp_10.42.42.5(pid=13907): stderr: | [0;m[38;5;43m20221213233856462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233856462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233856463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233856463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233856465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233856466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233856466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:57.959286 run osmo-stp_10.42.42.5(pid=13907): stdout: | (launched: 2022-12-13_23:38:56.273511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:58.089313 run osmo-stp_10.42.42.5(pid=13907): stderr: | [0;m[38;5;43m20221213233856462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233856462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233856463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233856463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233856465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233856466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233856466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:58.242725 run patchelf(pid=13910): Terminating (SIGINT) 23:38:58.419071 run patchelf(pid=13910): Terminated: ok {rc=0} 23:38:58.545971 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13907): Process ended prematurely: osmo-stp_10.42.42.5(pid=13907) [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13907)] [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 23:38:58.555499 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:38:58.583432 run osmo-hlr_10.42.42.2(pid=13904): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13904)] 23:38:58.633890 run osmo-hlr_10.42.42.2(pid=13904): stdout: | (launched: 2022-12-13_23:38:55.297590) 23:38:58.685886 run osmo-hlr_10.42.42.2(pid=13904): stderr: | [0;m[1;31m20221213233855495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233855495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233855495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233855495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233855495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233855495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233855508 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233855517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233855517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233855517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:58.738161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13903): Terminating (SIGTERM) 23:38:58.780187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13906): Terminating (SIGTERM) 23:38:58.822168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13909): Terminating (SIGTERM) 23:38:58.864645 --- ParallelTerminationStrategy: PID 13903 died... 23:38:58.885230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13903): Terminated: ok {rc=0} 23:38:58.931661 --- ParallelTerminationStrategy: PID 13906 died... 23:38:58.951524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13906): Terminated: ok {rc=0} 23:38:58.997840 --- ParallelTerminationStrategy: PID 13909 died... 23:38:59.017717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13909): Terminated: ok {rc=0} 23:38:59.106327 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:39:00.419671 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:00.427266 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:39:00.462209 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:39:00.497451 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:39:00.550861 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:39:00.584905 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:39:00.621080 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:39:01.179995 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:39:01.186804 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:01.199174 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:39:01.283328 tst switch_tch_pdch.py: using LAC 37024 23:39:01.445630 tst switch_tch_pdch.py: using RAC 49 23:39:01.591507 tst switch_tch_pdch.py: using CellId 37024 23:39:01.718717 tst switch_tch_pdch.py: using BVCI 37025 23:39:01.838495 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:01.851149 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:01.863299 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:01.875383 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:01.888705 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:01.901911 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:01.915014 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:01.928149 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:39:02.070882 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:39:02.210605 tst switch_tch_pdch.py:51: start network... 23:39:02.433789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:39:02.976230 run create_hlr_db(pid=13992): Launched 23:39:03.133946 bus /gobi_6: Setting Powered False 23:39:04.196104 run create_hlr_db(pid=13992): Terminated: ok {rc=0} 23:39:04.670805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14186): Launched 23:39:05.011874 run osmo-hlr_10.42.42.2(pid=14187): Launched 23:39:05.256820 run osmo-stp_10.42.42.5: Starting osmo-stp 23:39:05.925727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14189): Launched 23:39:06.234997 run osmo-stp_10.42.42.5(pid=14191): Launched 23:39:06.452561 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:39:07.086664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14194): Launched 23:39:07.219177 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:39:07.495213 run patchelf(pid=14195): Launched 23:39:07.688270 run osmo-stp_10.42.42.5(pid=14191): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14191)] 23:39:07.826637 run osmo-stp_10.42.42.5(pid=14191): stdout: | (launched: 2022-12-13_23:39:06.173553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:07.963750 run osmo-stp_10.42.42.5(pid=14191): stderr: | [0;m[38;5;43m20221213233906396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233906396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233906396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233906397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233906397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233906397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233906398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:08.103016 run osmo-stp_10.42.42.5(pid=14191): stdout: | (launched: 2022-12-13_23:39:06.173553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:08.235429 run osmo-stp_10.42.42.5(pid=14191): stderr: | [0;m[38;5;43m20221213233906396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233906396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233906396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233906397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233906397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233906397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233906398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:08.392424 run patchelf(pid=14195): Terminating (SIGINT) 23:39:08.574185 run patchelf(pid=14195): Terminated: ok {rc=0} 23:39:08.704527 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14191): Process ended prematurely: osmo-stp_10.42.42.5(pid=14191) [trial-2396↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14191)] [trial-2396↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:39:08.715014 tst switch_tch_pdch.py:54: Test FAILED (7.5 sec) 23:39:08.743999 run osmo-hlr_10.42.42.2(pid=14187): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14187)] 23:39:08.800893 run osmo-hlr_10.42.42.2(pid=14187): stdout: | (launched: 2022-12-13_23:39:04.946932) 23:39:08.855519 run osmo-hlr_10.42.42.2(pid=14187): stderr: | [0;m[1;31m20221213233905260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233905260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233905260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233905260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233905260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233905260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233905282 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233905294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233905295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233905295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:08.910851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14186): Terminating (SIGTERM) 23:39:08.954838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14189): Terminating (SIGTERM) 23:39:09.002584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14194): Terminating (SIGTERM) 23:39:09.049967 --- ParallelTerminationStrategy: PID 14186 died... 23:39:09.072473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14186): Terminated: ok {rc=0} 23:39:09.122963 --- ParallelTerminationStrategy: PID 14189 died... 23:39:09.144547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14189): Terminated: ok {rc=0} 23:39:09.194279 --- ParallelTerminationStrategy: PID 14194 died... 23:39:09.216277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14194): Terminated: ok {rc=0} 23:39:09.309815 bus /gobi_0: Setting Powered False 23:39:10.413294 bus /gobi_0: Setting Powered False 23:39:11.534921 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:39:12.804032 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:12.811089 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:39:12.849262 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:39:12.886908 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:39:12.940630 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:39:12.977049 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:39:13.014767 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:39:13.569625 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:39:13.576496 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:13.589329 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:39:13.663616 tst switch_tch_pdch.py: using LAC 37025 23:39:13.791975 tst switch_tch_pdch.py: using RAC 50 23:39:13.916692 tst switch_tch_pdch.py: using CellId 37025 23:39:14.042128 tst switch_tch_pdch.py: using BVCI 37026 23:39:14.160322 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:14.173786 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:14.186260 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:14.198800 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:14.212156 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:14.225655 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:14.239343 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:14.252479 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:39:14.379199 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:39:14.503101 tst switch_tch_pdch.py:51: start network... 23:39:14.724109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:39:15.206719 run create_hlr_db(pid=14199): Launched 23:39:15.367515 bus /gobi_6: Setting Powered False 23:39:16.448410 run create_hlr_db(pid=14199): Terminated: ok {rc=0} 23:39:16.985380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14201): Launched 23:39:17.380474 run osmo-hlr_10.42.42.2(pid=14202): Launched 23:39:17.624180 run osmo-stp_10.42.42.5: Starting osmo-stp 23:39:18.320245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14204): Launched 23:39:18.661268 run osmo-stp_10.42.42.5(pid=14205): Launched 23:39:18.903433 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:39:19.525722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14207): Launched 23:39:19.658031 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:39:19.937872 run patchelf(pid=14208): Launched 23:39:20.133195 run osmo-stp_10.42.42.5(pid=14205): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14205)] 23:39:20.274144 run osmo-stp_10.42.42.5(pid=14205): stdout: | (launched: 2022-12-13_23:39:18.598068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:20.415682 run osmo-stp_10.42.42.5(pid=14205): stderr: | [0;m[38;5;43m20221213233918893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233918893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233918894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233918894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233918895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233918895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233918895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:20.557187 run osmo-stp_10.42.42.5(pid=14205): stdout: | (launched: 2022-12-13_23:39:18.598068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:20.693627 run osmo-stp_10.42.42.5(pid=14205): stderr: | [0;m[38;5;43m20221213233918893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233918893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233918894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233918894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233918895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233918895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233918895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:20.855124 run patchelf(pid=14208): Terminating (SIGINT) 23:39:21.038823 run patchelf(pid=14208): Terminated: ok {rc=0} 23:39:21.170277 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14205): Process ended prematurely: osmo-stp_10.42.42.5(pid=14205) [trial-2396↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14205)] [trial-2396↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:39:21.181979 tst switch_tch_pdch.py:54: Test FAILED (7.6 sec) 23:39:21.212516 run osmo-hlr_10.42.42.2(pid=14202): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14202)] 23:39:21.267921 run osmo-hlr_10.42.42.2(pid=14202): stdout: | (launched: 2022-12-13_23:39:17.308753) 23:39:21.322657 run osmo-hlr_10.42.42.2(pid=14202): stderr: | [0;m[1;31m20221213233917648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233917648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233917650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233917652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233917652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233917652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233917674 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233917699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233917699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233917699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:21.378708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14201): Terminating (SIGTERM) 23:39:21.422792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14204): Terminating (SIGTERM) 23:39:21.469883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14207): Terminating (SIGTERM) 23:39:21.517207 --- ParallelTerminationStrategy: PID 14201 died... 23:39:21.540395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14201): Terminated: ok {rc=0} 23:39:21.592305 --- ParallelTerminationStrategy: PID 14204 died... 23:39:21.613950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14204): Terminated: ok {rc=0} 23:39:21.663557 --- ParallelTerminationStrategy: PID 14207 died... 23:39:21.685620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14207): Terminated: ok {rc=0} 23:39:21.780370 bus /gobi_0: Setting Powered False 23:39:22.885997 bus /gobi_0: Setting Powered False 23:39:24.004271 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 23:39:25.255995 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:25.259805 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:39:25.292734 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 23:39:25.299415 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:39:25.350139 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:39:25.383339 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 23:39:25.389930 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:39:25.930141 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 23:39:25.935228 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 23:39:25.946174 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:39:25.995687 tst mo_mt_sms.py: using LAC 37026 23:39:26.118692 tst mo_mt_sms.py: using RAC 51 23:39:26.239354 tst mo_mt_sms.py: using CellId 37026 23:39:26.361360 tst mo_mt_sms.py: using BVCI 37027 23:39:26.474434 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:39:26.590784 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:39:26.703188 tst mo_mt_sms.py:9: start nitb and bts... 23:39:26.900880 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:39:27.500123 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14214): Launched 23:39:27.791634 run osmo-nitb_10.42.42.2(pid=14215): Launched 23:39:27.953621 run osmo-nitb_10.42.42.2(pid=14215): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14215)] 23:39:28.084741 run osmo-nitb_10.42.42.2(pid=14215): stdout: | (launched: 2022-12-13_23:39:27.737906) 23:39:28.217378 run osmo-nitb_10.42.42.2(pid=14215): stderr: | (launched: 2022-12-13_23:39:27.781421) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:39:28.350203 run osmo-nitb_10.42.42.2(pid=14215): stdout: | (launched: 2022-12-13_23:39:27.737906) 23:39:28.477271 run osmo-nitb_10.42.42.2(pid=14215): stderr: | (launched: 2022-12-13_23:39:27.781421) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14215): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14215) [trial-2396↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14215)] 23:39:28.902219 tst osmo-nitb_10.42.42.2(pid=14215): stdout: | (launched: 2022-12-13_23:39:27.737906) 23:39:29.020489 tst osmo-nitb_10.42.42.2(pid=14215): stderr: | (launched: 2022-12-13_23:39:27.781421) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:39:29.159438 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=14215): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14215) [trial-2396↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14215)] [trial-2396↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 23:39:29.167747 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 23:39:29.174155 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14214): Terminating (SIGTERM) 23:39:29.382002 --- ParallelTerminationStrategy: PID 14214 died... 23:39:29.402053 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14214): Terminated: ok {rc=0} 23:39:29.487769 bus /sierra_3: Setting Powered False 23:39:30.587498 bus /sierra_3: Setting Powered False 23:39:31.711839 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 sms:trx-sysmocell5000 --------------------------------------------------------------------- 23:39:32.915358 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:32.920057 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:39:32.955319 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:39:32.983489 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:39:33.035848 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:39:33.069475 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:39:33.096150 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:39:33.649840 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 23:39:33.655708 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:33.667185 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:39:33.716686 tst mo_mt_sms.py: using LAC 37027 23:39:33.838112 tst mo_mt_sms.py: using RAC 52 23:39:33.959728 tst mo_mt_sms.py: using CellId 37027 23:39:34.074747 tst mo_mt_sms.py: using BVCI 37028 23:39:34.180643 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:34.191297 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:34.201863 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:34.212198 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:34.222724 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:34.233149 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:39:34.346585 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:39:34.461871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:39:34.915453 run create_hlr_db(pid=14219): Launched 23:39:35.034420 bus /sierra_2: Setting Powered False 23:39:36.092288 run create_hlr_db(pid=14219): Terminated: ok {rc=0} 23:39:36.520436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14221): Launched 23:39:36.834343 run osmo-hlr_10.42.42.2(pid=14222): Launched 23:39:36.953839 run osmo-stp_10.42.42.5: Starting osmo-stp 23:39:37.498120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14224): Launched 23:39:37.810025 run osmo-stp_10.42.42.5(pid=14225): Launched 23:39:37.929094 run osmo-msc_10.42.42.6: Starting osmo-msc 23:39:38.495773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14227): Launched 23:39:38.808188 run osmo-msc_10.42.42.6(pid=14228): Launched 23:39:38.983150 run osmo-stp_10.42.42.5(pid=14225): ERR: Terminated: ERROR {rc=1} [trial-2396↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14225)] 23:39:39.116019 run osmo-stp_10.42.42.5(pid=14225): stdout: | (launched: 2022-12-13_23:39:37.753184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:39.249717 run osmo-stp_10.42.42.5(pid=14225): stderr: | [0;m[38;5;43m20221213233937944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233937944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233937944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233937945 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233937945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233937945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233937945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:39.382323 run osmo-stp_10.42.42.5(pid=14225): stdout: | (launched: 2022-12-13_23:39:37.753184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:39.507038 run osmo-stp_10.42.42.5(pid=14225): stderr: | [0;m[38;5;43m20221213233937944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233937944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233937944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233937945 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233937945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233937945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233937945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:39.656212 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14225): Process ended prematurely: osmo-stp_10.42.42.5(pid=14225) [trial-2396↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14225)] [trial-2396↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 23:39:39.664898 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 23:39:39.691994 run osmo-hlr_10.42.42.2(pid=14222): ERR: Terminated: ERROR {rc=237} [trial-2396↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14222)] 23:39:39.742732 run osmo-hlr_10.42.42.2(pid=14222): stdout: | (launched: 2022-12-13_23:39:36.777794) 23:39:39.794560 run osmo-hlr_10.42.42.2(pid=14222): stderr: | [0;m[1;31m20221213233936973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233936973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233936973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233936974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233936974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233936974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233936987 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233936995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233936995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233936995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:39.867919 run osmo-msc_10.42.42.6(pid=14228): ERR: Terminated: ERROR {rc=2} [trial-2396↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14228)] 23:39:39.917791 run osmo-msc_10.42.42.6(pid=14228): stdout: | (launched: 2022-12-13_23:39:38.751266) 23:39:39.969902 run osmo-msc_10.42.42.6(pid=14228): stderr: | [0;m[38;5;43m20221213233939071 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233939071 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f80c7950c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233939071 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233939071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233939071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233939071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233939073 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233939073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233939074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233939074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:39:40.022499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14221): Terminating (SIGTERM) 23:39:40.063896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14224): Terminating (SIGTERM) 23:39:40.106097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14227): Terminating (SIGTERM) 23:39:40.148248 --- ParallelTerminationStrategy: PID 14221 died... 23:39:40.168441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14221): Terminated: ok {rc=0} 23:39:40.214597 --- ParallelTerminationStrategy: PID 14224 died... 23:39:40.234492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14224): Terminated: ok {rc=0} 23:39:40.280648 --- ParallelTerminationStrategy: PID 14227 died... 23:39:40.300550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14227): Terminated: ok {rc=0} 23:39:40.388438 bus /sierra_3: Setting Powered False 23:39:41.486938 bus /sierra_3: Setting Powered False 23:39:42.603002 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 23:39:43.832056 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:43.835982 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:39:43.869154 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 23:39:43.875878 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 23:39:43.910339 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:39:43.943580 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 23:39:43.950222 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 23:39:44.474820 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2396 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 23:39:44.480566 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 23:39:44.492168 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:39:44.540273 tst assert_extension.py: using LAC 37028 23:39:44.658366 tst assert_extension.py: using RAC 53 23:39:44.773604 tst assert_extension.py: using CellId 37028 23:39:44.887018 tst assert_extension.py: using BVCI 37029 23:39:44.992673 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 23:39:45.110826 tst assert_extension.py:10: start nitb and bts... 23:39:45.322751 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:39:45.986415 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14233): Launched 23:39:46.297697 run osmo-nitb_10.42.42.2(pid=14234): Launched 23:39:46.467010 run osmo-nitb_10.42.42.2(pid=14234): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14234)] 23:39:46.606025 run osmo-nitb_10.42.42.2(pid=14234): stdout: | (launched: 2022-12-13_23:39:46.236857) 23:39:46.744779 run osmo-nitb_10.42.42.2(pid=14234): stderr: | (launched: 2022-12-13_23:39:46.281558) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:39:46.884323 run osmo-nitb_10.42.42.2(pid=14234): stdout: | (launched: 2022-12-13_23:39:46.236857) 23:39:47.017578 run osmo-nitb_10.42.42.2(pid=14234): stderr: | (launched: 2022-12-13_23:39:46.281558) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14234): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14234) [trial-2396↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14234)] 23:39:47.413680 tst osmo-nitb_10.42.42.2(pid=14234): stdout: | (launched: 2022-12-13_23:39:46.236857) 23:39:47.532340 tst osmo-nitb_10.42.42.2(pid=14234): stderr: | (launched: 2022-12-13_23:39:46.281558) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:39:47.671867 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14234): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14234) [trial-2396↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14234)] [trial-2396↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 23:39:47.680258 tst assert_extension.py:12: Test FAILED (3.2 sec) 23:39:47.686888 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14233): Terminating (SIGTERM) 23:39:47.895532 --- ParallelTerminationStrategy: PID 14233 died... 23:39:47.916414 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14233): Terminated: ok {rc=0} 23:39:47.999430 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 23:39:49.180237 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:49.184331 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:39:49.218356 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:39:49.246477 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 23:39:49.282311 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:39:49.316911 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:39:49.344565 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 23:39:49.876850 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2396 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 23:39:49.882215 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:49.893382 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:39:49.945109 tst assert_extension.py: using LAC 37029 23:39:50.068756 tst assert_extension.py: using RAC 54 23:39:50.193580 tst assert_extension.py: using CellId 37029 23:39:50.318287 tst assert_extension.py: using BVCI 37030 23:39:50.431816 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:50.443143 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:50.454187 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:50.465414 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:50.476719 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:50.488199 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 23:39:50.602538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:39:51.055475 run create_hlr_db(pid=14239): Launched 23:39:51.179400 bus /sierra_2: Setting Powered False 23:39:52.241148 run create_hlr_db(pid=14239): Terminated: ok {rc=0} 23:39:52.677392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14241): Launched 23:39:52.989601 run osmo-hlr_10.42.42.2(pid=14242): Launched 23:39:53.110429 run osmo-stp_10.42.42.5: Starting osmo-stp 23:39:53.736565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14244): Launched 23:39:54.043571 run osmo-stp_10.42.42.5(pid=14245): Launched 23:39:54.162096 run osmo-msc_10.42.42.6: Starting osmo-msc 23:39:54.719307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14247): Launched 23:39:55.026293 run osmo-msc_10.42.42.6(pid=14248): Launched 23:39:55.198237 run osmo-stp_10.42.42.5(pid=14245): ERR: Terminated: ERROR {rc=1} [trial-2396↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14245)] 23:39:55.328472 run osmo-stp_10.42.42.5(pid=14245): stdout: | (launched: 2022-12-13_23:39:53.987913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:55.460361 run osmo-stp_10.42.42.5(pid=14245): stderr: | [0;m[38;5;43m20221213233954175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233954175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233954175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233954176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233954179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233954179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233954179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:55.591242 run osmo-stp_10.42.42.5(pid=14245): stdout: | (launched: 2022-12-13_23:39:53.987913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:55.714319 run osmo-stp_10.42.42.5(pid=14245): stderr: | [0;m[38;5;43m20221213233954175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213233954175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213233954175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213233954176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213233954179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213233954179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213233954179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:55.861683 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14245): Process ended prematurely: osmo-stp_10.42.42.5(pid=14245) [trial-2396↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14245)] [trial-2396↪ussd:trx-sysmocell5000↪assert_extension.py:17] 23:39:55.870506 tst assert_extension.py:17: Test FAILED (6.0 sec) 23:39:55.897619 run osmo-hlr_10.42.42.2(pid=14242): ERR: Terminated: ERROR {rc=237} [trial-2396↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14242)] 23:39:55.948264 run osmo-hlr_10.42.42.2(pid=14242): stdout: | (launched: 2022-12-13_23:39:52.933029) 23:39:56.000234 run osmo-hlr_10.42.42.2(pid=14242): stderr: | [0;m[1;31m20221213233953127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213233953127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213233953127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213233953127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213233953127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213233953127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213233953139 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213233953147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213233953148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213233953148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:56.072634 run osmo-msc_10.42.42.6(pid=14248): ERR: Terminated: ERROR {rc=2} [trial-2396↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14248)] 23:39:56.122933 run osmo-msc_10.42.42.6(pid=14248): stdout: | (launched: 2022-12-13_23:39:54.970591) 23:39:56.174890 run osmo-msc_10.42.42.6(pid=14248): stderr: | [0;m[38;5;43m20221213233955288 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213233955288 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f904f733c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213233955288 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213233955288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213233955288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213233955289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213233955290 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213233955291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213233955291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213233955291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:39:56.226990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14241): Terminating (SIGTERM) 23:39:56.268538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14244): Terminating (SIGTERM) 23:39:56.310462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14247): Terminating (SIGTERM) 23:39:56.352446 --- ParallelTerminationStrategy: PID 14241 died... 23:39:56.372720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14241): Terminated: ok {rc=0} 23:39:56.418852 --- ParallelTerminationStrategy: PID 14244 died... 23:39:56.438458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14244): Terminated: ok {rc=0} 23:39:56.484324 --- ParallelTerminationStrategy: PID 14247 died... 23:39:56.503989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14247): Terminated: ok {rc=0} 23:39:56.590766 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:39:57.810527 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:57.818102 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:39:57.851963 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:39:57.878542 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:39:57.932870 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:39:57.966954 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:39:57.993348 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:39:58.540920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:39:58.588868 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:58.600159 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:39:58.667252 tst mo_mt_call.py: using LAC 37030 23:39:58.781351 tst mo_mt_call.py: using RAC 55 23:39:58.895655 tst mo_mt_call.py: using CellId 37030 23:39:59.009603 tst mo_mt_call.py: using BVCI 37031 23:39:59.115988 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:59.127081 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:59.138058 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:59.148923 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:59.159982 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:59.170963 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:39:59.283782 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:39:59.396346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:39:59.852619 run create_hlr_db(pid=14254): Launched 23:39:59.973208 bus /sierra_2: Setting Powered False 23:40:01.035334 run create_hlr_db(pid=14254): Terminated: ok {rc=0} 23:40:01.510294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14259): Launched 23:40:01.858939 run osmo-hlr_10.42.42.2(pid=14260): Launched 23:40:02.101334 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:02.636853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14262): Launched 23:40:02.929323 run osmo-stp_10.42.42.5(pid=14263): Launched 23:40:03.040234 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:03.573091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14265): Launched 23:40:03.866366 run osmo-msc_10.42.42.6(pid=14266): Launched 23:40:04.030389 run osmo-stp_10.42.42.5(pid=14263): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14263)] 23:40:04.155942 run osmo-stp_10.42.42.5(pid=14263): stdout: | (launched: 2022-12-13_23:40:02.875914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:04.281860 run osmo-stp_10.42.42.5(pid=14263): stderr: | [0;m[38;5;43m20221213234003045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234003045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234003046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234003046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234003047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234003047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234003047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:04.405303 run osmo-stp_10.42.42.5(pid=14263): stdout: | (launched: 2022-12-13_23:40:02.875914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:04.522635 run osmo-stp_10.42.42.5(pid=14263): stderr: | [0;m[38;5;43m20221213234003045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234003045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234003046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234003046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234003047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234003047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234003047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:04.663348 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14263): Process ended prematurely: osmo-stp_10.42.42.5(pid=14263) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14263)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:40:04.672157 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:40:04.698066 run osmo-hlr_10.42.42.2(pid=14260): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14260)] 23:40:04.745536 run osmo-hlr_10.42.42.2(pid=14260): stdout: | (launched: 2022-12-13_23:40:01.784881) 23:40:04.794611 run osmo-hlr_10.42.42.2(pid=14260): stderr: | [0;m[1;31m20221213234002088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234002088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234002088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234002088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234002088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234002088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234002103 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234002112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234002112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234002112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:04.862890 run osmo-msc_10.42.42.6(pid=14266): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14266)] 23:40:04.910031 run osmo-msc_10.42.42.6(pid=14266): stdout: | (launched: 2022-12-13_23:40:03.812720) 23:40:04.958826 run osmo-msc_10.42.42.6(pid=14266): stderr: | [0;m[38;5;43m20221213234004083 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234004083 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcb9c502c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234004083 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234004083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234004084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234004084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234004085 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234004086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234004086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234004086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:05.008180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14259): Terminating (SIGTERM) 23:40:05.047379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14262): Terminating (SIGTERM) 23:40:05.086739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14265): Terminating (SIGTERM) 23:40:05.126317 --- ParallelTerminationStrategy: PID 14259 died... 23:40:05.144548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14259): Terminated: ok {rc=0} 23:40:05.188000 --- ParallelTerminationStrategy: PID 14262 died... 23:40:05.206415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14262): Terminated: ok {rc=0} 23:40:05.249616 --- ParallelTerminationStrategy: PID 14265 died... 23:40:05.267872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14265): Terminated: ok {rc=0} 23:40:05.353477 bus /sierra_3: Setting Powered False 23:40:06.451891 bus /sierra_3: Setting Powered False 23:40:07.570778 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:40:08.718907 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:08.731243 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:40:08.803212 tst mo_mt_call_osmux.py: using LAC 37031 23:40:08.921589 tst mo_mt_call_osmux.py: using RAC 56 23:40:09.038557 tst mo_mt_call_osmux.py: using CellId 37031 23:40:09.157457 tst mo_mt_call_osmux.py: using BVCI 37032 23:40:09.264115 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:09.275459 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:09.286512 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:09.297451 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:09.308370 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:09.319317 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:40:09.437951 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:40:09.557376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:10.045876 run create_hlr_db(pid=14268): Launched 23:40:10.167284 bus /sierra_2: Setting Powered False 23:40:11.230111 run create_hlr_db(pid=14268): Terminated: ok {rc=0} 23:40:11.654105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14270): Launched 23:40:11.949125 run osmo-hlr_10.42.42.2(pid=14271): Launched 23:40:12.062039 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:12.588500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14273): Launched 23:40:12.883688 run osmo-stp_10.42.42.5(pid=14274): Launched 23:40:12.995623 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:13.529832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14276): Launched 23:40:13.823809 run osmo-msc_10.42.42.6(pid=14277): Launched 23:40:13.988234 run osmo-stp_10.42.42.5(pid=14274): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14274)] 23:40:14.112615 run osmo-stp_10.42.42.5(pid=14274): stdout: | (launched: 2022-12-13_23:40:12.829531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:14.238426 run osmo-stp_10.42.42.5(pid=14274): stderr: | [0;m[38;5;43m20221213234013001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234013001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234013001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234013002 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234013002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234013002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234013002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:14.361581 run osmo-stp_10.42.42.5(pid=14274): stdout: | (launched: 2022-12-13_23:40:12.829531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:14.479150 run osmo-stp_10.42.42.5(pid=14274): stderr: | [0;m[38;5;43m20221213234013001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234013001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234013001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234013002 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234013002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234013002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234013002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:14.619567 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14274): Process ended prematurely: osmo-stp_10.42.42.5(pid=14274) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14274)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:40:14.628574 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 23:40:14.654502 run osmo-hlr_10.42.42.2(pid=14271): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14271)] 23:40:14.702783 run osmo-hlr_10.42.42.2(pid=14271): stdout: | (launched: 2022-12-13_23:40:11.894805) 23:40:14.751973 run osmo-hlr_10.42.42.2(pid=14271): stderr: | [0;m[1;31m20221213234012071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234012071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234012071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234012071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234012071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234012071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234012084 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234012094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234012095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234012095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:14.819999 run osmo-msc_10.42.42.6(pid=14277): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14277)] 23:40:14.867166 run osmo-msc_10.42.42.6(pid=14277): stdout: | (launched: 2022-12-13_23:40:13.770017) 23:40:14.915809 run osmo-msc_10.42.42.6(pid=14277): stderr: | [0;m[38;5;43m20221213234014041 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234014041 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f92d1c1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234014041 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234014041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234014041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234014041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234014043 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234014043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234014044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234014044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:14.964865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14270): Terminating (SIGTERM) 23:40:15.003813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14273): Terminating (SIGTERM) 23:40:15.043143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14276): Terminating (SIGTERM) 23:40:15.082531 --- ParallelTerminationStrategy: PID 14270 died... 23:40:15.101476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14270): Terminated: ok {rc=0} 23:40:15.145271 --- ParallelTerminationStrategy: PID 14273 died... 23:40:15.163518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14273): Terminated: ok {rc=0} 23:40:15.206862 --- ParallelTerminationStrategy: PID 14276 died... 23:40:15.225399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14276): Terminated: ok {rc=0} 23:40:15.310250 bus /sierra_3: Setting Powered False 23:40:16.410029 bus /sierra_3: Setting Powered False 23:40:17.529299 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:40:18.785643 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:40:18.793233 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:40:18.826140 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:40:18.852651 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:40:18.904765 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:40:18.939083 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:40:18.966974 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:40:19.515041 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:40:19.563474 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:19.574721 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:40:19.644901 tst mo_mt_call.py: using LAC 37032 23:40:19.760744 tst mo_mt_call.py: using RAC 57 23:40:19.877266 tst mo_mt_call.py: using CellId 37032 23:40:19.992630 tst mo_mt_call.py: using BVCI 37033 23:40:20.099262 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:20.110523 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:20.121612 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:20.132486 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:20.143575 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:20.154536 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:40:20.273754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:40:20.392399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:20.880049 run create_hlr_db(pid=14282): Launched 23:40:21.000938 bus /sierra_2: Setting Powered False 23:40:22.064280 run create_hlr_db(pid=14282): Terminated: ok {rc=0} 23:40:22.488818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14284): Launched 23:40:22.785406 run osmo-hlr_10.42.42.2(pid=14285): Launched 23:40:22.897646 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:23.404808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14287): Launched 23:40:23.698626 run osmo-stp_10.42.42.5(pid=14288): Launched 23:40:23.810621 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:24.349119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14290): Launched 23:40:24.644035 run osmo-msc_10.42.42.6(pid=14291): Launched 23:40:24.808913 run osmo-stp_10.42.42.5(pid=14288): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14288)] 23:40:24.933781 run osmo-stp_10.42.42.5(pid=14288): stdout: | (launched: 2022-12-13_23:40:23.645196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:25.058896 run osmo-stp_10.42.42.5(pid=14288): stderr: | [0;m[38;5;43m20221213234023814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234023814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234023814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234023815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234023817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234023817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234023817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:25.181822 run osmo-stp_10.42.42.5(pid=14288): stdout: | (launched: 2022-12-13_23:40:23.645196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:25.299380 run osmo-stp_10.42.42.5(pid=14288): stderr: | [0;m[38;5;43m20221213234023814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234023814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234023814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234023815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234023817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234023817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234023817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:25.440190 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14288): Process ended prematurely: osmo-stp_10.42.42.5(pid=14288) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14288)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:40:25.449060 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 23:40:25.474988 run osmo-hlr_10.42.42.2(pid=14285): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14285)] 23:40:25.522505 run osmo-hlr_10.42.42.2(pid=14285): stdout: | (launched: 2022-12-13_23:40:22.730595) 23:40:25.571384 run osmo-hlr_10.42.42.2(pid=14285): stderr: | [0;m[1;31m20221213234022906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234022906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234022906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234022906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234022906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234022906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234022918 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234022929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234022930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234022930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:25.639427 run osmo-msc_10.42.42.6(pid=14291): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14291)] 23:40:25.686410 run osmo-msc_10.42.42.6(pid=14291): stdout: | (launched: 2022-12-13_23:40:24.590238) 23:40:25.735088 run osmo-msc_10.42.42.6(pid=14291): stderr: | [0;m[38;5;43m20221213234024860 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234024860 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f582b049c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234024860 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234024860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234024860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234024861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234024862 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234024863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234024863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234024863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:25.784162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14284): Terminating (SIGTERM) 23:40:25.823074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14287): Terminating (SIGTERM) 23:40:25.861838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14290): Terminating (SIGTERM) 23:40:25.900898 --- ParallelTerminationStrategy: PID 14284 died... 23:40:25.919539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14284): Terminated: ok {rc=0} 23:40:25.962583 --- ParallelTerminationStrategy: PID 14287 died... 23:40:25.980612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14287): Terminated: ok {rc=0} 23:40:26.023456 --- ParallelTerminationStrategy: PID 14290 died... 23:40:26.041717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14290): Terminated: ok {rc=0} 23:40:26.125612 bus /sierra_3: Setting Powered False 23:40:27.225069 bus /sierra_3: Setting Powered False 23:40:28.339936 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:40:29.485628 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:29.497994 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:40:29.569975 tst mo_mt_call_osmux.py: using LAC 37033 23:40:29.690324 tst mo_mt_call_osmux.py: using RAC 58 23:40:29.808366 tst mo_mt_call_osmux.py: using CellId 37033 23:40:29.930954 tst mo_mt_call_osmux.py: using BVCI 37034 23:40:30.039019 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:30.050445 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:30.061446 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:30.072328 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:30.083359 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:30.094430 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:40:30.209538 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:40:30.327230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:30.785937 run create_hlr_db(pid=14293): Launched 23:40:30.924894 bus /sierra_2: Setting Powered False 23:40:31.982898 run create_hlr_db(pid=14293): Terminated: ok {rc=0} 23:40:32.402010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14295): Launched 23:40:32.696216 run osmo-hlr_10.42.42.2(pid=14296): Launched 23:40:32.807892 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:33.314559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14298): Launched 23:40:33.610020 run osmo-stp_10.42.42.5(pid=14299): Launched 23:40:33.722232 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:34.255726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14301): Launched 23:40:34.551188 run osmo-msc_10.42.42.6(pid=14302): Launched 23:40:34.716623 run osmo-stp_10.42.42.5(pid=14299): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14299)] 23:40:34.841297 run osmo-stp_10.42.42.5(pid=14299): stdout: | (launched: 2022-12-13_23:40:33.555677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:34.967206 run osmo-stp_10.42.42.5(pid=14299): stderr: | [0;m[38;5;43m20221213234033723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234033723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234033724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234033724 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234033725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234033725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234033725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:35.090627 run osmo-stp_10.42.42.5(pid=14299): stdout: | (launched: 2022-12-13_23:40:33.555677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:35.208375 run osmo-stp_10.42.42.5(pid=14299): stderr: | [0;m[38;5;43m20221213234033723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234033723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234033724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234033724 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234033725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234033725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234033725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:35.349467 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14299): Process ended prematurely: osmo-stp_10.42.42.5(pid=14299) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14299)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:40:35.358361 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 23:40:35.384132 run osmo-hlr_10.42.42.2(pid=14296): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14296)] 23:40:35.431234 run osmo-hlr_10.42.42.2(pid=14296): stdout: | (launched: 2022-12-13_23:40:32.642826) 23:40:35.479696 run osmo-hlr_10.42.42.2(pid=14296): stderr: | [0;m[1;31m20221213234032819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234032819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234032819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234032819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234032819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234032819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234032831 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234032839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234032839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234032839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:35.547390 run osmo-msc_10.42.42.6(pid=14302): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14302)] 23:40:35.594036 run osmo-msc_10.42.42.6(pid=14302): stdout: | (launched: 2022-12-13_23:40:34.497397) 23:40:35.642360 run osmo-msc_10.42.42.6(pid=14302): stderr: | [0;m[38;5;43m20221213234034769 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234034769 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f86f13aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234034769 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234034769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234034769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234034769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234034771 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234034771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234034772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234034772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:35.691064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14295): Terminating (SIGTERM) 23:40:35.729859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14298): Terminating (SIGTERM) 23:40:35.768914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14301): Terminating (SIGTERM) 23:40:35.807724 --- ParallelTerminationStrategy: PID 14295 died... 23:40:35.826510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14295): Terminated: ok {rc=0} 23:40:35.869539 --- ParallelTerminationStrategy: PID 14298 died... 23:40:35.887773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14298): Terminated: ok {rc=0} 23:40:35.930780 --- ParallelTerminationStrategy: PID 14301 died... 23:40:35.948873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14301): Terminated: ok {rc=0} 23:40:36.033283 bus /sierra_3: Setting Powered False 23:40:37.131234 bus /sierra_3: Setting Powered False 23:40:38.245534 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:40:39.495760 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:40:39.502343 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:40:39.535247 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:40:39.561629 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:40:39.613122 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:40:39.646614 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:40:39.673303 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:40:40.227424 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:40:40.278670 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:40.290323 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:40:40.362767 tst mo_mt_call.py: using LAC 37034 23:40:40.486782 tst mo_mt_call.py: using RAC 59 23:40:40.613074 tst mo_mt_call.py: using CellId 37034 23:40:40.737195 tst mo_mt_call.py: using BVCI 37035 23:40:40.853630 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:40.865406 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:40.876740 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:40.888143 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:40.899939 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:40.911734 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:40:41.027785 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:40:41.146664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:41.637299 run create_hlr_db(pid=14307): Launched 23:40:41.757452 bus /sierra_2: Setting Powered False 23:40:42.820836 run create_hlr_db(pid=14307): Terminated: ok {rc=0} 23:40:43.245353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14309): Launched 23:40:43.542184 run osmo-hlr_10.42.42.2(pid=14310): Launched 23:40:43.657331 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:44.169209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14312): Launched 23:40:44.466331 run osmo-stp_10.42.42.5(pid=14313): Launched 23:40:44.580195 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:45.116117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14315): Launched 23:40:45.413026 run osmo-msc_10.42.42.6(pid=14316): Launched 23:40:45.579184 run osmo-stp_10.42.42.5(pid=14313): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14313)] 23:40:45.704435 run osmo-stp_10.42.42.5(pid=14313): stdout: | (launched: 2022-12-13_23:40:44.412058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:45.830193 run osmo-stp_10.42.42.5(pid=14313): stderr: | [0;m[38;5;43m20221213234044581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234044581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234044581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234044582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234044582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234044582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234044582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:45.974664 run osmo-stp_10.42.42.5(pid=14313): stdout: | (launched: 2022-12-13_23:40:44.412058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:46.095420 run osmo-stp_10.42.42.5(pid=14313): stderr: | [0;m[38;5;43m20221213234044581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234044581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234044581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234044582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234044582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234044582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234044582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:46.239815 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14313): Process ended prematurely: osmo-stp_10.42.42.5(pid=14313) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14313)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:40:46.249183 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:40:46.276133 run osmo-hlr_10.42.42.2(pid=14310): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14310)] 23:40:46.324888 run osmo-hlr_10.42.42.2(pid=14310): stdout: | (launched: 2022-12-13_23:40:43.488326) 23:40:46.375139 run osmo-hlr_10.42.42.2(pid=14310): stderr: | [0;m[1;31m20221213234043664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234043664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234043664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234043664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234043664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234043664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234043676 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234043685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234043685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234043685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:46.444694 run osmo-msc_10.42.42.6(pid=14316): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14316)] 23:40:46.493446 run osmo-msc_10.42.42.6(pid=14316): stdout: | (launched: 2022-12-13_23:40:45.358649) 23:40:46.543766 run osmo-msc_10.42.42.6(pid=14316): stderr: | [0;m[38;5;43m20221213234045629 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234045629 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0e5edc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234045629 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234045629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234045630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234045630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234045632 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234045632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234045632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234045632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:46.595419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14309): Terminating (SIGTERM) 23:40:46.635710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14312): Terminating (SIGTERM) 23:40:46.676836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14315): Terminating (SIGTERM) 23:40:46.717794 --- ParallelTerminationStrategy: PID 14309 died... 23:40:46.737367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14309): Terminated: ok {rc=0} 23:40:46.782409 --- ParallelTerminationStrategy: PID 14312 died... 23:40:46.801532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14312): Terminated: ok {rc=0} 23:40:46.845851 --- ParallelTerminationStrategy: PID 14315 died... 23:40:46.865105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14315): Terminated: ok {rc=0} 23:40:46.949134 bus /sierra_3: Setting Powered False 23:40:48.042567 bus /sierra_3: Setting Powered False 23:40:49.156756 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:40:50.301242 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:50.313120 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:40:50.386379 tst mo_mt_call_osmux.py: using LAC 37035 23:40:50.505695 tst mo_mt_call_osmux.py: using RAC 60 23:40:50.621283 tst mo_mt_call_osmux.py: using CellId 37035 23:40:50.735715 tst mo_mt_call_osmux.py: using BVCI 37036 23:40:50.851868 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:50.863740 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:50.875366 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:50.886950 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:50.899183 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:50.910903 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:40:51.030817 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:40:51.148069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:51.608371 run create_hlr_db(pid=14318): Launched 23:40:51.730259 bus /sierra_2: Setting Powered False 23:40:52.790045 run create_hlr_db(pid=14318): Terminated: ok {rc=0} 23:40:53.222344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14321): Launched 23:40:53.538051 run osmo-hlr_10.42.42.2(pid=14322): Launched 23:40:53.659963 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:54.207746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14324): Launched 23:40:54.523563 run osmo-stp_10.42.42.5(pid=14325): Launched 23:40:54.645254 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:55.216544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14327): Launched 23:40:55.533162 run osmo-msc_10.42.42.6(pid=14328): Launched 23:40:55.710546 run osmo-stp_10.42.42.5(pid=14325): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14325)] 23:40:55.845314 run osmo-stp_10.42.42.5(pid=14325): stdout: | (launched: 2022-12-13_23:40:54.466551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:55.980896 run osmo-stp_10.42.42.5(pid=14325): stderr: | [0;m[38;5;43m20221213234054659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234054659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234054659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234054659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234054660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234054660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234054660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:56.115396 run osmo-stp_10.42.42.5(pid=14325): stdout: | (launched: 2022-12-13_23:40:54.466551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:56.242011 run osmo-stp_10.42.42.5(pid=14325): stderr: | [0;m[38;5;43m20221213234054659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234054659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234054659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234054659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234054660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234054660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234054660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:56.392940 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14325): Process ended prematurely: osmo-stp_10.42.42.5(pid=14325) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14325)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:40:56.402479 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:40:56.429918 run osmo-hlr_10.42.42.2(pid=14322): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14322)] 23:40:56.480180 run osmo-hlr_10.42.42.2(pid=14322): stdout: | (launched: 2022-12-13_23:40:53.480805) 23:40:56.531850 run osmo-hlr_10.42.42.2(pid=14322): stderr: | [0;m[1;31m20221213234053678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234053678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234053678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234053678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234053678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234053678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234053690 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234053698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234053699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234053699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:56.604226 run osmo-msc_10.42.42.6(pid=14328): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14328)] 23:40:56.653494 run osmo-msc_10.42.42.6(pid=14328): stdout: | (launched: 2022-12-13_23:40:55.475785) 23:40:56.704658 run osmo-msc_10.42.42.6(pid=14328): stderr: | [0;m[38;5;43m20221213234055795 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234055796 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff4bbc54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234055796 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234055796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234055796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234055796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234055798 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234055798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234055798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234055798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:56.756322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14321): Terminating (SIGTERM) 23:40:56.797753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14324): Terminating (SIGTERM) 23:40:56.839542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14327): Terminating (SIGTERM) 23:40:56.881209 --- ParallelTerminationStrategy: PID 14321 died... 23:40:56.901274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14321): Terminated: ok {rc=0} 23:40:56.947025 --- ParallelTerminationStrategy: PID 14324 died... 23:40:56.966469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14324): Terminated: ok {rc=0} 23:40:57.011865 --- ParallelTerminationStrategy: PID 14327 died... 23:40:57.031305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14327): Terminated: ok {rc=0} 23:40:57.118796 bus /sierra_3: Setting Powered False 23:40:58.215478 bus /sierra_3: Setting Powered False 23:40:59.333334 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:41:00.587117 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:41:00.594440 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:41:00.630727 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:41:00.658356 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:41:00.711945 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:41:00.745619 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:41:00.771831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:41:01.331285 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:41:01.380789 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:01.393073 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:41:01.463318 tst mo_mt_call.py: using LAC 37036 23:41:01.591365 tst mo_mt_call.py: using RAC 61 23:41:01.719452 tst mo_mt_call.py: using CellId 37036 23:41:01.838526 tst mo_mt_call.py: using BVCI 37037 23:41:01.987201 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:02.002319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:02.016785 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:02.030374 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:02.044034 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:02.058898 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:41:02.205509 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:41:02.324261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:02.784824 run create_hlr_db(pid=14333): Launched 23:41:02.907908 bus /sierra_2: Setting Powered False 23:41:03.967081 run create_hlr_db(pid=14333): Terminated: ok {rc=0} 23:41:04.398938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14335): Launched 23:41:04.714699 run osmo-hlr_10.42.42.2(pid=14336): Launched 23:41:04.834490 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:05.378523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14338): Launched 23:41:05.693943 run osmo-stp_10.42.42.5(pid=14339): Launched 23:41:05.814751 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:06.387025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14341): Launched 23:41:06.704047 run osmo-msc_10.42.42.6(pid=14342): Launched 23:41:06.880826 run osmo-stp_10.42.42.5(pid=14339): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14339)] 23:41:07.014898 run osmo-stp_10.42.42.5(pid=14339): stdout: | (launched: 2022-12-13_23:41:05.637023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:07.149879 run osmo-stp_10.42.42.5(pid=14339): stderr: | [0;m[38;5;43m20221213234105829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234105829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234105829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234105830 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234105830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234105830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234105830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:07.284105 run osmo-stp_10.42.42.5(pid=14339): stdout: | (launched: 2022-12-13_23:41:05.637023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:07.410268 run osmo-stp_10.42.42.5(pid=14339): stderr: | [0;m[38;5;43m20221213234105829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234105829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234105829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234105830 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234105830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234105830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234105830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:07.561310 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14339): Process ended prematurely: osmo-stp_10.42.42.5(pid=14339) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14339)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:41:07.570704 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:41:07.597852 run osmo-hlr_10.42.42.2(pid=14336): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14336)] 23:41:07.648075 run osmo-hlr_10.42.42.2(pid=14336): stdout: | (launched: 2022-12-13_23:41:04.657711) 23:41:07.699657 run osmo-hlr_10.42.42.2(pid=14336): stderr: | [0;m[1;31m20221213234104856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234104856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234104856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234104856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234104856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234104856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234104868 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234104877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234104877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234104877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:07.773417 run osmo-msc_10.42.42.6(pid=14342): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14342)] 23:41:07.822638 run osmo-msc_10.42.42.6(pid=14342): stdout: | (launched: 2022-12-13_23:41:06.646590) 23:41:07.873886 run osmo-msc_10.42.42.6(pid=14342): stderr: | [0;m[38;5;43m20221213234106965 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234106966 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2f38e42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234106966 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234106966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234106966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234106966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234106968 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234106968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234106968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234106968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:07.925324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14335): Terminating (SIGTERM) 23:41:07.966749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14338): Terminating (SIGTERM) 23:41:08.008184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14341): Terminating (SIGTERM) 23:41:08.049994 --- ParallelTerminationStrategy: PID 14335 died... 23:41:08.070068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14335): Terminated: ok {rc=0} 23:41:08.116154 --- ParallelTerminationStrategy: PID 14338 died... 23:41:08.135681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14338): Terminated: ok {rc=0} 23:41:08.181519 --- ParallelTerminationStrategy: PID 14341 died... 23:41:08.200937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14341): Terminated: ok {rc=0} 23:41:08.287649 bus /sierra_3: Setting Powered False 23:41:09.385538 bus /sierra_3: Setting Powered False 23:41:10.499301 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:41:11.644086 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:11.655995 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:41:11.725237 tst mo_mt_call_osmux.py: using LAC 37037 23:41:11.849748 tst mo_mt_call_osmux.py: using RAC 62 23:41:11.974748 tst mo_mt_call_osmux.py: using CellId 37037 23:41:12.098591 tst mo_mt_call_osmux.py: using BVCI 37038 23:41:12.213996 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:12.225879 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:12.237366 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:12.248812 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:12.260729 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:12.272472 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:41:12.391004 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:41:12.505478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:12.965976 run create_hlr_db(pid=14344): Launched 23:41:13.087079 bus /sierra_2: Setting Powered False 23:41:14.146831 run create_hlr_db(pid=14344): Terminated: ok {rc=0} 23:41:14.560505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14346): Launched 23:41:14.856557 run osmo-hlr_10.42.42.2(pid=14347): Launched 23:41:14.969258 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:15.483097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14349): Launched 23:41:15.779798 run osmo-stp_10.42.42.5(pid=14350): Launched 23:41:15.904931 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:16.618271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14352): Launched 23:41:16.965688 run osmo-msc_10.42.42.6(pid=14353): Launched 23:41:17.176461 run osmo-stp_10.42.42.5(pid=14350): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14350)] 23:41:17.385794 run osmo-stp_10.42.42.5(pid=14350): stdout: | (launched: 2022-12-13_23:41:15.726037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:17.522437 run osmo-stp_10.42.42.5(pid=14350): stderr: | [0;m[38;5;43m20221213234115985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234115986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234115986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234115986 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234115987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234115987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234115987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:17.659348 run osmo-stp_10.42.42.5(pid=14350): stdout: | (launched: 2022-12-13_23:41:15.726037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:17.786577 run osmo-stp_10.42.42.5(pid=14350): stderr: | [0;m[38;5;43m20221213234115985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234115986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234115986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234115986 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234115987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234115987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234115987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:17.938561 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14350): Process ended prematurely: osmo-stp_10.42.42.5(pid=14350) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14350)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:41:17.948041 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:41:17.975811 run osmo-hlr_10.42.42.2(pid=14347): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14347)] 23:41:18.026935 run osmo-hlr_10.42.42.2(pid=14347): stdout: | (launched: 2022-12-13_23:41:14.802597) 23:41:18.079288 run osmo-hlr_10.42.42.2(pid=14347): stderr: | [0;m[1;31m20221213234114977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234114977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234114977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234114978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234114978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234114978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234114990 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234115000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234115000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234115000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:18.152452 run osmo-msc_10.42.42.6(pid=14353): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14353)] 23:41:18.202631 run osmo-msc_10.42.42.6(pid=14353): stdout: | (launched: 2022-12-13_23:41:16.895937) 23:41:18.254670 run osmo-msc_10.42.42.6(pid=14353): stderr: | [0;m[38;5;43m20221213234117355 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234117356 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f62425f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234117356 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234117356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234117356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234117356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234117358 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234117358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234117359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234117359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:18.307180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14346): Terminating (SIGTERM) 23:41:18.349040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14349): Terminating (SIGTERM) 23:41:18.391103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14352): Terminating (SIGTERM) 23:41:18.433836 --- ParallelTerminationStrategy: PID 14346 died... 23:41:18.454398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14346): Terminated: ok {rc=0} 23:41:18.500919 --- ParallelTerminationStrategy: PID 14349 died... 23:41:18.521352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14349): Terminated: ok {rc=0} 23:41:18.567632 --- ParallelTerminationStrategy: PID 14352 died... 23:41:18.587636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14352): Terminated: ok {rc=0} 23:41:18.676584 bus /sierra_3: Setting Powered False 23:41:19.774455 bus /sierra_3: Setting Powered False 23:41:20.893167 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:41:22.144618 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:41:22.150817 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:41:22.183852 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:41:22.210163 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:41:22.260678 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:41:22.293612 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:41:22.319720 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:41:22.873668 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:41:22.921418 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:22.932788 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:41:23.005984 tst mo_mt_call.py: using LAC 37038 23:41:23.122324 tst mo_mt_call.py: using RAC 63 23:41:23.241398 tst mo_mt_call.py: using CellId 37038 23:41:23.357284 tst mo_mt_call.py: using BVCI 37039 23:41:23.464519 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:23.475700 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:23.486727 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:23.497782 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:23.508734 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:23.519675 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:41:23.634548 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:41:23.754202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:24.244603 run create_hlr_db(pid=14358): Launched 23:41:24.366606 bus /sierra_2: Setting Powered False 23:41:25.429482 run create_hlr_db(pid=14358): Terminated: ok {rc=0} 23:41:25.853117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14361): Launched 23:41:26.149561 run osmo-hlr_10.42.42.2(pid=14362): Launched 23:41:26.262783 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:26.777140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14364): Launched 23:41:27.073500 run osmo-stp_10.42.42.5(pid=14365): Launched 23:41:27.186101 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:27.723261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14367): Launched 23:41:28.018221 run osmo-msc_10.42.42.6(pid=14368): Launched 23:41:28.183459 run osmo-stp_10.42.42.5(pid=14365): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14365)] 23:41:28.312021 run osmo-stp_10.42.42.5(pid=14365): stdout: | (launched: 2022-12-13_23:41:27.019613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:28.437727 run osmo-stp_10.42.42.5(pid=14365): stderr: | [0;m[38;5;43m20221213234127189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234127189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234127190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234127190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234127190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234127191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234127191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:28.561180 run osmo-stp_10.42.42.5(pid=14365): stdout: | (launched: 2022-12-13_23:41:27.019613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:28.678919 run osmo-stp_10.42.42.5(pid=14365): stderr: | [0;m[38;5;43m20221213234127189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234127189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234127190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234127190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234127190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234127191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234127191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:28.820492 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14365): Process ended prematurely: osmo-stp_10.42.42.5(pid=14365) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14365)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:41:28.829575 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 23:41:28.855677 run osmo-hlr_10.42.42.2(pid=14362): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14362)] 23:41:28.902518 run osmo-hlr_10.42.42.2(pid=14362): stdout: | (launched: 2022-12-13_23:41:26.095217) 23:41:28.951024 run osmo-hlr_10.42.42.2(pid=14362): stderr: | [0;m[1;31m20221213234126270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234126270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234126270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234126270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234126270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234126270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234126282 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234126291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234126291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234126291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:29.018991 run osmo-msc_10.42.42.6(pid=14368): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14368)] 23:41:29.065570 run osmo-msc_10.42.42.6(pid=14368): stdout: | (launched: 2022-12-13_23:41:27.964170) 23:41:29.113985 run osmo-msc_10.42.42.6(pid=14368): stderr: | [0;m[38;5;43m20221213234128235 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234128235 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff3c2816c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234128235 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234128236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234128236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234128236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234128238 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234128238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234128238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234128238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:29.162891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14361): Terminating (SIGTERM) 23:41:29.201637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14364): Terminating (SIGTERM) 23:41:29.241134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14367): Terminating (SIGTERM) 23:41:29.280353 --- ParallelTerminationStrategy: PID 14361 died... 23:41:29.299298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14361): Terminated: ok {rc=0} 23:41:29.342567 --- ParallelTerminationStrategy: PID 14364 died... 23:41:29.360746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14364): Terminated: ok {rc=0} 23:41:29.403698 --- ParallelTerminationStrategy: PID 14367 died... 23:41:29.422084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14367): Terminated: ok {rc=0} 23:41:29.506383 bus /sierra_3: Setting Powered False 23:41:30.605393 bus /sierra_3: Setting Powered False 23:41:31.719341 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:41:32.871566 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:32.883383 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:41:32.952582 tst mo_mt_call_osmux.py: using LAC 37039 23:41:33.068790 tst mo_mt_call_osmux.py: using RAC 64 23:41:33.185515 tst mo_mt_call_osmux.py: using CellId 37039 23:41:33.301539 tst mo_mt_call_osmux.py: using BVCI 37040 23:41:33.419302 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:33.431228 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:33.442917 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:33.454670 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:33.466694 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:33.478524 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:41:33.595584 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:41:33.713778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:34.204364 run create_hlr_db(pid=14370): Launched 23:41:34.325320 bus /sierra_2: Setting Powered False 23:41:35.388332 run create_hlr_db(pid=14370): Terminated: ok {rc=0} 23:41:35.813487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14372): Launched 23:41:36.110241 run osmo-hlr_10.42.42.2(pid=14373): Launched 23:41:36.223609 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:36.733121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14375): Launched 23:41:37.029927 run osmo-stp_10.42.42.5(pid=14376): Launched 23:41:37.142664 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:37.679657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14378): Launched 23:41:37.976453 run osmo-msc_10.42.42.6(pid=14379): Launched 23:41:38.143349 run osmo-stp_10.42.42.5(pid=14376): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14376)] 23:41:38.269538 run osmo-stp_10.42.42.5(pid=14376): stdout: | (launched: 2022-12-13_23:41:36.976019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:38.396308 run osmo-stp_10.42.42.5(pid=14376): stderr: | [0;m[38;5;43m20221213234137145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234137145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234137145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234137146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234137146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234137146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234137146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:38.520478 run osmo-stp_10.42.42.5(pid=14376): stdout: | (launched: 2022-12-13_23:41:36.976019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:38.638658 run osmo-stp_10.42.42.5(pid=14376): stderr: | [0;m[38;5;43m20221213234137145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234137145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234137145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234137146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234137146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234137146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234137146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:38.780706 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14376): Process ended prematurely: osmo-stp_10.42.42.5(pid=14376) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14376)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:41:38.789672 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:41:38.815651 run osmo-hlr_10.42.42.2(pid=14373): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14373)] 23:41:38.862772 run osmo-hlr_10.42.42.2(pid=14373): stdout: | (launched: 2022-12-13_23:41:36.056157) 23:41:38.912482 run osmo-hlr_10.42.42.2(pid=14373): stderr: | [0;m[1;31m20221213234136233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234136233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234136233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234136233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234136233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234136233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234136245 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234136253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234136254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234136254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:38.980775 run osmo-msc_10.42.42.6(pid=14379): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14379)] 23:41:39.027838 run osmo-msc_10.42.42.6(pid=14379): stdout: | (launched: 2022-12-13_23:41:37.922286) 23:41:39.076342 run osmo-msc_10.42.42.6(pid=14379): stderr: | [0;m[38;5;43m20221213234138196 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234138196 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc706cb4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234138196 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234138196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234138196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234138196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234138198 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234138199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234138199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234138199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:39.125597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14372): Terminating (SIGTERM) 23:41:39.165275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14375): Terminating (SIGTERM) 23:41:39.204627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14378): Terminating (SIGTERM) 23:41:39.244098 --- ParallelTerminationStrategy: PID 14372 died... 23:41:39.263241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14372): Terminated: ok {rc=0} 23:41:39.306884 --- ParallelTerminationStrategy: PID 14375 died... 23:41:39.325383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14375): Terminated: ok {rc=0} 23:41:39.368683 --- ParallelTerminationStrategy: PID 14378 died... 23:41:39.387230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14378): Terminated: ok {rc=0} 23:41:39.471922 bus /sierra_3: Setting Powered False 23:41:40.570910 bus /sierra_3: Setting Powered False 23:41:41.688095 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:41:42.947470 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:41:42.955931 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:41:42.991954 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:41:43.019348 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:41:43.071555 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:41:43.105006 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:41:43.132136 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:41:43.686850 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:41:43.739213 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:43.751134 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:41:43.822739 tst mo_mt_call.py: using LAC 37040 23:41:43.948337 tst mo_mt_call.py: using RAC 65 23:41:44.071999 tst mo_mt_call.py: using CellId 37040 23:41:44.196759 tst mo_mt_call.py: using BVCI 37041 23:41:44.304937 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:44.316219 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:44.327190 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:44.338182 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:44.349285 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:44.360273 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:41:44.478894 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:41:44.594412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:45.054853 run create_hlr_db(pid=14384): Launched 23:41:45.176295 bus /sierra_2: Setting Powered False 23:41:46.260255 run create_hlr_db(pid=14384): Terminated: ok {rc=0} 23:41:46.709049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14386): Launched 23:41:47.018522 run osmo-hlr_10.42.42.2(pid=14387): Launched 23:41:47.164358 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:47.694449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14389): Launched 23:41:47.990377 run osmo-stp_10.42.42.5(pid=14390): Launched 23:41:48.102155 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:48.636530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14392): Launched 23:41:48.933002 run osmo-msc_10.42.42.6(pid=14393): Launched 23:41:49.099599 run osmo-stp_10.42.42.5(pid=14390): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14390)] 23:41:49.225280 run osmo-stp_10.42.42.5(pid=14390): stdout: | (launched: 2022-12-13_23:41:47.935959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:49.350825 run osmo-stp_10.42.42.5(pid=14390): stderr: | [0;m[38;5;43m20221213234148105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234148105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234148105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234148106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234148106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234148106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234148106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:49.473794 run osmo-stp_10.42.42.5(pid=14390): stdout: | (launched: 2022-12-13_23:41:47.935959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:49.591220 run osmo-stp_10.42.42.5(pid=14390): stderr: | [0;m[38;5;43m20221213234148105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234148105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234148105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234148106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234148106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234148106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234148106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:49.731908 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14390): Process ended prematurely: osmo-stp_10.42.42.5(pid=14390) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14390)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:41:49.741233 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:41:49.766903 run osmo-hlr_10.42.42.2(pid=14387): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14387)] 23:41:49.813772 run osmo-hlr_10.42.42.2(pid=14387): stdout: | (launched: 2022-12-13_23:41:46.955879) 23:41:49.862300 run osmo-hlr_10.42.42.2(pid=14387): stderr: | [0;m[1;31m20221213234147315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234147315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234147315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234147315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234147315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234147315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234147328 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234147337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234147338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234147338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:49.930185 run osmo-msc_10.42.42.6(pid=14393): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14393)] 23:41:49.976914 run osmo-msc_10.42.42.6(pid=14393): stdout: | (launched: 2022-12-13_23:41:48.878848) 23:41:50.025575 run osmo-msc_10.42.42.6(pid=14393): stderr: | [0;m[38;5;43m20221213234149151 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234149151 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f71e4353c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234149151 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234149151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234149151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234149152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234149153 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234149154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234149154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234149154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:50.074386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14386): Terminating (SIGTERM) 23:41:50.113129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14389): Terminating (SIGTERM) 23:41:50.152128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14392): Terminating (SIGTERM) 23:41:50.191311 --- ParallelTerminationStrategy: PID 14386 died... 23:41:50.210075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14386): Terminated: ok {rc=0} 23:41:50.253010 --- ParallelTerminationStrategy: PID 14389 died... 23:41:50.271193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14389): Terminated: ok {rc=0} 23:41:50.314173 --- ParallelTerminationStrategy: PID 14392 died... 23:41:50.332458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14392): Terminated: ok {rc=0} 23:41:50.417404 bus /sierra_3: Setting Powered False 23:41:51.515368 bus /sierra_3: Setting Powered False 23:41:52.629697 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:41:53.773685 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:53.785553 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:41:53.855604 tst mo_mt_call_osmux.py: using LAC 37041 23:41:53.973808 tst mo_mt_call_osmux.py: using RAC 66 23:41:54.092835 tst mo_mt_call_osmux.py: using CellId 37041 23:41:54.210221 tst mo_mt_call_osmux.py: using BVCI 37042 23:41:54.319062 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:54.330322 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:54.341385 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:54.352787 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:54.363879 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:54.374929 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:41:54.493690 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:41:54.609041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:55.069406 run create_hlr_db(pid=14395): Launched 23:41:55.190054 bus /sierra_2: Setting Powered False 23:41:56.250788 run create_hlr_db(pid=14395): Terminated: ok {rc=0} 23:41:56.685709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14397): Launched 23:41:57.001730 run osmo-hlr_10.42.42.2(pid=14398): Launched 23:41:57.122585 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:57.668841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14400): Launched 23:41:57.985366 run osmo-stp_10.42.42.5(pid=14401): Launched 23:41:58.106265 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:58.682340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14403): Launched 23:41:58.998751 run osmo-msc_10.42.42.6(pid=14404): Launched 23:41:59.175548 run osmo-stp_10.42.42.5(pid=14401): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14401)] 23:41:59.310222 run osmo-stp_10.42.42.5(pid=14401): stdout: | (launched: 2022-12-13_23:41:57.927376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:59.445385 run osmo-stp_10.42.42.5(pid=14401): stderr: | [0;m[38;5;43m20221213234158117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234158117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234158118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234158118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234158120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234158121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234158121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:59.579530 run osmo-stp_10.42.42.5(pid=14401): stdout: | (launched: 2022-12-13_23:41:57.927376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:59.706354 run osmo-stp_10.42.42.5(pid=14401): stderr: | [0;m[38;5;43m20221213234158117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234158117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234158118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234158118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234158120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234158121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234158121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:59.857753 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14401): Process ended prematurely: osmo-stp_10.42.42.5(pid=14401) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14401)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:41:59.867385 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:41:59.894765 run osmo-hlr_10.42.42.2(pid=14398): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14398)] 23:41:59.945164 run osmo-hlr_10.42.42.2(pid=14398): stdout: | (launched: 2022-12-13_23:41:56.944569) 23:41:59.996923 run osmo-hlr_10.42.42.2(pid=14398): stderr: | [0;m[1;31m20221213234157142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234157142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234157142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234157142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234157142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234157142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234157156 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234157166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234157166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234157166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:00.068840 run osmo-msc_10.42.42.6(pid=14404): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14404)] 23:42:00.118441 run osmo-msc_10.42.42.6(pid=14404): stdout: | (launched: 2022-12-13_23:41:58.941325) 23:42:00.170380 run osmo-msc_10.42.42.6(pid=14404): stderr: | [0;m[38;5;43m20221213234159260 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234159260 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f16dd100c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234159260 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234159260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234159261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234159261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234159262 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234159263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234159263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234159263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:42:00.223179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14397): Terminating (SIGTERM) 23:42:00.264569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14400): Terminating (SIGTERM) 23:42:00.306228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14403): Terminating (SIGTERM) 23:42:00.349467 --- ParallelTerminationStrategy: PID 14397 died... 23:42:00.369518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14397): Terminated: ok {rc=0} 23:42:00.415490 --- ParallelTerminationStrategy: PID 14400 died... 23:42:00.435215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14400): Terminated: ok {rc=0} 23:42:00.481208 --- ParallelTerminationStrategy: PID 14403 died... 23:42:00.500765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14403): Terminated: ok {rc=0} 23:42:00.588599 bus /sierra_3: Setting Powered False 23:42:01.684218 bus /sierra_3: Setting Powered False 23:42:02.799651 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:42:04.045893 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:42:04.051239 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:42:04.085649 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:42:04.112030 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:42:04.163261 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:42:04.196314 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:42:04.222638 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:42:04.775683 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:42:04.825240 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:04.836250 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:42:04.905390 tst mo_mt_call.py: using LAC 37042 23:42:05.021059 tst mo_mt_call.py: using RAC 67 23:42:05.137670 tst mo_mt_call.py: using CellId 37042 23:42:05.255504 tst mo_mt_call.py: using BVCI 37043 23:42:05.363847 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:05.375083 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:05.386144 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:05.397189 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:05.408192 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:05.419496 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:42:05.540101 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:42:05.661423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:06.151921 run create_hlr_db(pid=14412): Launched 23:42:06.273983 bus /sierra_2: Setting Powered False 23:42:07.337095 run create_hlr_db(pid=14412): Terminated: ok {rc=0} 23:42:07.778612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14414): Launched 23:42:08.095015 run osmo-hlr_10.42.42.2(pid=14415): Launched 23:42:08.217179 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:08.763600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14417): Launched 23:42:09.080682 run osmo-stp_10.42.42.5(pid=14418): Launched 23:42:09.203308 run osmo-msc_10.42.42.6: Starting osmo-msc 23:42:09.778646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14420): Launched 23:42:10.096648 run osmo-msc_10.42.42.6(pid=14421): Launched 23:42:10.275068 run osmo-stp_10.42.42.5(pid=14418): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14418)] 23:42:10.409939 run osmo-stp_10.42.42.5(pid=14418): stdout: | (launched: 2022-12-13_23:42:09.023303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:10.545236 run osmo-stp_10.42.42.5(pid=14418): stderr: | [0;m[38;5;43m20221213234209215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234209215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234209215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234209216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234209218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234209218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234209218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:10.679503 run osmo-stp_10.42.42.5(pid=14418): stdout: | (launched: 2022-12-13_23:42:09.023303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:10.806854 run osmo-stp_10.42.42.5(pid=14418): stderr: | [0;m[38;5;43m20221213234209215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234209215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234209215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234209216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234209218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234209218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234209218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:10.959160 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14418): Process ended prematurely: osmo-stp_10.42.42.5(pid=14418) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14418)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:42:10.968632 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:42:10.996410 run osmo-hlr_10.42.42.2(pid=14415): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14415)] 23:42:11.047588 run osmo-hlr_10.42.42.2(pid=14415): stdout: | (launched: 2022-12-13_23:42:08.037927) 23:42:11.099965 run osmo-hlr_10.42.42.2(pid=14415): stderr: | [0;m[1;31m20221213234208235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234208235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234208235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234208235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234208235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234208235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234208248 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234208256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234208256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234208256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:11.173438 run osmo-msc_10.42.42.6(pid=14421): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14421)] 23:42:11.223878 run osmo-msc_10.42.42.6(pid=14421): stdout: | (launched: 2022-12-13_23:42:10.038929) 23:42:11.275865 run osmo-msc_10.42.42.6(pid=14421): stderr: | [0;m[38;5;43m20221213234210361 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234210361 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ce1570c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234210361 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234210361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234210362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234210362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234210363 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234210364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234210364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234210364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:42:11.328582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14414): Terminating (SIGTERM) 23:42:11.370653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14417): Terminating (SIGTERM) 23:42:11.412785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14420): Terminating (SIGTERM) 23:42:11.455675 --- ParallelTerminationStrategy: PID 14414 died... 23:42:11.476007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14414): Terminated: ok {rc=0} 23:42:11.522614 --- ParallelTerminationStrategy: PID 14417 died... 23:42:11.542527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14417): Terminated: ok {rc=0} 23:42:11.589159 --- ParallelTerminationStrategy: PID 14420 died... 23:42:11.609065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14420): Terminated: ok {rc=0} 23:42:11.698651 bus /sierra_3: Setting Powered False 23:42:12.796328 bus /sierra_3: Setting Powered False 23:42:13.913682 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:42:15.061509 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:15.073784 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:42:15.147737 tst mo_mt_call_osmux.py: using LAC 37043 23:42:15.274925 tst mo_mt_call_osmux.py: using RAC 68 23:42:15.401384 tst mo_mt_call_osmux.py: using CellId 37043 23:42:15.527880 tst mo_mt_call_osmux.py: using BVCI 37044 23:42:15.644458 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:15.655955 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:15.667296 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:15.678567 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:15.690506 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:15.702125 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:42:15.818250 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:42:15.970029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:16.501869 run create_hlr_db(pid=14423): Launched 23:42:16.658403 bus /sierra_2: Setting Powered False 23:42:17.721667 run create_hlr_db(pid=14423): Terminated: ok {rc=0} 23:42:18.145377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14425): Launched 23:42:18.441918 run osmo-hlr_10.42.42.2(pid=14426): Launched 23:42:18.555830 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:19.080236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14428): Launched 23:42:19.376204 run osmo-stp_10.42.42.5(pid=14429): Launched 23:42:19.490518 run osmo-msc_10.42.42.6: Starting osmo-msc 23:42:20.024846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14431): Launched 23:42:20.320280 run osmo-msc_10.42.42.6(pid=14432): Launched 23:42:20.486839 run osmo-stp_10.42.42.5(pid=14429): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14429)] 23:42:20.613901 run osmo-stp_10.42.42.5(pid=14429): stdout: | (launched: 2022-12-13_23:42:19.322480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:20.739413 run osmo-stp_10.42.42.5(pid=14429): stderr: | [0;m[38;5;43m20221213234219493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234219493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234219493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234219493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234219494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234219494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234219494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:20.863103 run osmo-stp_10.42.42.5(pid=14429): stdout: | (launched: 2022-12-13_23:42:19.322480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:20.980636 run osmo-stp_10.42.42.5(pid=14429): stderr: | [0;m[38;5;43m20221213234219493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234219493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234219493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234219493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234219494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234219494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234219494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:21.121906 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14429): Process ended prematurely: osmo-stp_10.42.42.5(pid=14429) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14429)] [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:42:21.130589 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:42:21.156264 run osmo-hlr_10.42.42.2(pid=14426): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14426)] 23:42:21.203219 run osmo-hlr_10.42.42.2(pid=14426): stdout: | (launched: 2022-12-13_23:42:18.387781) 23:42:21.252461 run osmo-hlr_10.42.42.2(pid=14426): stderr: | [0;m[1;31m20221213234218561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234218562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234218562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234218562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234218562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234218562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234218574 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234218585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234218585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234218586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:21.320583 run osmo-msc_10.42.42.6(pid=14432): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14432)] 23:42:21.367496 run osmo-msc_10.42.42.6(pid=14432): stdout: | (launched: 2022-12-13_23:42:20.266735) 23:42:21.415929 run osmo-msc_10.42.42.6(pid=14432): stderr: | [0;m[38;5;43m20221213234220536 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234220537 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2fd54e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234220537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234220537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234220537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234220537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234220539 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234220539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234220540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234220540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:42:21.464693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14425): Terminating (SIGTERM) 23:42:21.503494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14428): Terminating (SIGTERM) 23:42:21.542349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14431): Terminating (SIGTERM) 23:42:21.581405 --- ParallelTerminationStrategy: PID 14425 died... 23:42:21.599887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14425): Terminated: ok {rc=0} 23:42:21.643341 --- ParallelTerminationStrategy: PID 14428 died... 23:42:21.661729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14428): Terminated: ok {rc=0} 23:42:21.704591 --- ParallelTerminationStrategy: PID 14431 died... 23:42:21.722884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14431): Terminated: ok {rc=0} 23:42:21.808072 bus /sierra_3: Setting Powered False 23:42:22.906396 bus /sierra_3: Setting Powered False 23:42:24.020686 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 23:42:25.274341 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:42:25.279256 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:42:25.313519 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:42:25.341626 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 23:42:25.428078 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:42:25.462605 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:42:25.490322 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 23:42:26.076244 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2396 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 23:42:26.082167 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:26.093584 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:42:26.146323 tst emergency_mo_mt_call.py: using LAC 37044 23:42:26.270633 tst emergency_mo_mt_call.py: using RAC 69 23:42:26.392108 tst emergency_mo_mt_call.py: using CellId 37044 23:42:26.513393 tst emergency_mo_mt_call.py: using BVCI 37045 23:42:26.626164 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:26.637703 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:26.648870 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:26.660096 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:26.671772 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:26.683532 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:26.803920 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:26.921805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:27.403218 run create_hlr_db(pid=14437): Launched 23:42:27.521429 bus /sierra_2: Setting Powered False 23:42:28.583070 run create_hlr_db(pid=14437): Terminated: ok {rc=0} 23:42:29.016177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14439): Launched 23:42:29.326783 run osmo-hlr_10.42.42.2(pid=14440): Launched 23:42:29.445396 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:29.983169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14442): Launched 23:42:30.294070 run osmo-stp_10.42.42.5(pid=14443): Launched 23:42:30.426439 tst emergency_mo_mt_call.py: using MSISDN 8391 23:42:30.584042 run osmo-msc_10.42.42.6: Starting osmo-msc 23:42:31.186674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14445): Launched 23:42:31.515483 run osmo-msc_10.42.42.6(pid=14446): Launched 23:42:31.942438 run osmo-stp_10.42.42.5(pid=14443): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14443)] 23:42:32.204536 run osmo-stp_10.42.42.5(pid=14443): stdout: | (launched: 2022-12-13_23:42:30.237732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:32.336733 run osmo-stp_10.42.42.5(pid=14443): stderr: | [0;m[38;5;43m20221213234230430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234230430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234230430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234230430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234230431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234230431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234230431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:32.459427 run osmo-stp_10.42.42.5(pid=14443): stdout: | (launched: 2022-12-13_23:42:30.237732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:32.576178 run osmo-stp_10.42.42.5(pid=14443): stderr: | [0;m[38;5;43m20221213234230430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234230430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234230430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234230430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234230431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234230431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234230431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:32.715287 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=14443): Process ended prematurely: osmo-stp_10.42.42.5(pid=14443) [trial-2396↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14443)] [trial-2396↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 23:42:32.723706 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 23:42:32.749676 run osmo-hlr_10.42.42.2(pid=14440): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14440)] 23:42:32.798090 run osmo-hlr_10.42.42.2(pid=14440): stdout: | (launched: 2022-12-13_23:42:29.270469) 23:42:32.847742 run osmo-hlr_10.42.42.2(pid=14440): stderr: | [0;m[1;31m20221213234229468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234229468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234229468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234229468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234229468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234229468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234229482 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234229490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234229490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234229490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:32.916820 run osmo-msc_10.42.42.6(pid=14446): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14446)] 23:42:32.964580 run osmo-msc_10.42.42.6(pid=14446): stdout: | (launched: 2022-12-13_23:42:31.452147) 23:42:33.014084 run osmo-msc_10.42.42.6(pid=14446): stderr: | [0;m[38;5;43m20221213234231855 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234231855 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5844883c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234231855 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234231855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234231855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234231856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234231858 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234231861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234231861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234231861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:42:33.063673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14439): Terminating (SIGTERM) 23:42:33.103362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14442): Terminating (SIGTERM) 23:42:33.142972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14445): Terminating (SIGTERM) 23:42:33.182785 --- ParallelTerminationStrategy: PID 14439 died... 23:42:33.202026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14439): Terminated: ok {rc=0} 23:42:33.246098 --- ParallelTerminationStrategy: PID 14442 died... 23:42:33.264873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14442): Terminated: ok {rc=0} 23:42:33.308862 --- ParallelTerminationStrategy: PID 14445 died... 23:42:33.328088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14445): Terminated: ok {rc=0} 23:42:33.413647 bus /sierra_3: Setting Powered False 23:42:34.511841 bus /sierra_3: Setting Powered False 23:42:35.626945 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 23:42:36.713658 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:36.724801 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:42:36.776362 tst emergency_preemptive_call.py: using LAC 37045 23:42:36.896444 tst emergency_preemptive_call.py: using RAC 70 23:42:37.010335 tst emergency_preemptive_call.py: using CellId 37045 23:42:37.123783 tst emergency_preemptive_call.py: using BVCI 37046 23:42:37.228325 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:37.239156 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:37.249944 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:37.260338 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:37.270934 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:37.281452 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:37.401525 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:37.520434 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:37.634377 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:37.748693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:38.233625 run create_hlr_db(pid=14448): Launched 23:42:38.353071 bus /sierra_2: Setting Powered False 23:42:39.415067 run create_hlr_db(pid=14448): Terminated: ok {rc=0} 23:42:39.834903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14450): Launched 23:42:40.127261 run osmo-hlr_10.42.42.2(pid=14451): Launched 23:42:40.238112 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:40.739944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14453): Launched 23:42:41.030852 run osmo-stp_10.42.42.5(pid=14454): Launched 23:42:41.148897 tst emergency_preemptive_call.py: using MSISDN 8392 23:42:41.297280 run osmo-msc_10.42.42.6: Starting osmo-msc 23:42:41.821562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14456): Launched 23:42:42.113472 run osmo-msc_10.42.42.6(pid=14457): Launched 23:42:42.277271 run osmo-stp_10.42.42.5(pid=14454): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14454)] 23:42:42.401271 run osmo-stp_10.42.42.5(pid=14454): stdout: | (launched: 2022-12-13_23:42:40.977557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:42.525998 run osmo-stp_10.42.42.5(pid=14454): stderr: | [0;m[38;5;43m20221213234241146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234241147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234241147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234241147 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234241148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234241148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234241148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:42.648105 run osmo-stp_10.42.42.5(pid=14454): stdout: | (launched: 2022-12-13_23:42:40.977557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:42.764498 run osmo-stp_10.42.42.5(pid=14454): stderr: | [0;m[38;5;43m20221213234241146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234241147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234241147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234241147 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234241148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234241148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234241148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:42.903519 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=14454): Process ended prematurely: osmo-stp_10.42.42.5(pid=14454) [trial-2396↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14454)] [trial-2396↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 23:42:42.911962 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 23:42:42.937662 run osmo-hlr_10.42.42.2(pid=14451): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14451)] 23:42:42.985469 run osmo-hlr_10.42.42.2(pid=14451): stdout: | (launched: 2022-12-13_23:42:40.073847) 23:42:43.034542 run osmo-hlr_10.42.42.2(pid=14451): stderr: | [0;m[1;31m20221213234240249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234240249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234240249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234240249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234240249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234240249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234240264 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234240272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234240273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234240273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:43.103326 run osmo-msc_10.42.42.6(pid=14457): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14457)] 23:42:43.150987 run osmo-msc_10.42.42.6(pid=14457): stdout: | (launched: 2022-12-13_23:42:42.059873) 23:42:43.200115 run osmo-msc_10.42.42.6(pid=14457): stderr: | [0;m[38;5;43m20221213234242329 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234242329 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd60f146c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234242329 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234242330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234242330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234242330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234242332 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234242332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234242332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234242332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:42:43.249486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14450): Terminating (SIGTERM) 23:42:43.288705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14453): Terminating (SIGTERM) 23:42:43.327902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14456): Terminating (SIGTERM) 23:42:43.367319 --- ParallelTerminationStrategy: PID 14450 died... 23:42:43.386352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14450): Terminated: ok {rc=0} 23:42:43.430344 --- ParallelTerminationStrategy: PID 14453 died... 23:42:43.448825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14453): Terminated: ok {rc=0} 23:42:43.492113 --- ParallelTerminationStrategy: PID 14456 died... 23:42:43.510642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14456): Terminated: ok {rc=0} 23:42:43.595556 bus /sierra_9: Setting Powered False 23:42:44.694047 bus /sierra_9: Setting Powered False 23:42:45.808383 bus /sierra_8: Setting Powered False 23:42:46.932506 bus /sierra_8: Setting Powered False 23:42:48.065155 bus /sierra_3: Setting Powered False 23:42:49.163522 bus /sierra_3: Setting Powered False 23:42:50.279415 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 23:42:51.565124 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:42:51.569327 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:42:51.602135 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 23:42:51.640027 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 23:42:51.724570 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:42:51.757466 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 23:42:51.798330 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 23:42:52.392361 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 23:42:52.445537 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:52.457128 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:42:52.505856 tst cs_paging_gprs_active.py: using LAC 37046 23:42:52.630678 tst cs_paging_gprs_active.py: using RAC 71 23:42:52.755186 tst cs_paging_gprs_active.py: using CellId 37046 23:42:52.877976 tst cs_paging_gprs_active.py: using BVCI 37047 23:42:52.993579 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:53.004657 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:53.015610 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:53.026646 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:53.038130 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:53.049535 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:53.060863 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:53.072390 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:53.084179 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:53.205936 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:53.322431 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:42:53.523652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:42:53.822172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14462): Launched 23:42:54.080676 run iperf3-srv_10.42.42.10(pid=14463): Launched 23:42:54.192555 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:42:54.392706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:42:54.691758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14464): Launched 23:42:54.951006 run iperf3-srv_10.42.42.10(pid=14465): Launched 23:42:55.062294 tst cs_paging_gprs_active.py:38: start network... 23:42:55.262335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:55.724324 run create_hlr_db(pid=14466): Launched 23:42:55.846707 bus /sierra_2: Setting Powered False 23:42:56.906418 run create_hlr_db(pid=14466): Terminated: ok {rc=0} 23:42:57.321757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14468): Launched 23:42:57.619986 run osmo-hlr_10.42.42.2(pid=14469): Launched 23:42:57.733768 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:58.245328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14471): Launched 23:42:58.543025 run osmo-stp_10.42.42.5(pid=14472): Launched 23:42:58.656777 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:42:59.170819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14474): Launched 23:42:59.284418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:42:59.536230 run patchelf(pid=14475): Launched 23:42:59.702289 run osmo-stp_10.42.42.5(pid=14472): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14472)] 23:42:59.828654 run osmo-stp_10.42.42.5(pid=14472): stdout: | (launched: 2022-12-13_23:42:58.488925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:59.956484 run osmo-stp_10.42.42.5(pid=14472): stderr: | [0;m[38;5;43m20221213234258658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234258658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234258659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234258659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234258659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234258660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234258660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:00.084642 run osmo-stp_10.42.42.5(pid=14472): stdout: | (launched: 2022-12-13_23:42:58.488925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:00.207233 run osmo-stp_10.42.42.5(pid=14472): stderr: | [0;m[38;5;43m20221213234258658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234258658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234258659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234258659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234258659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234258660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234258660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:00.352533 run patchelf(pid=14475): Terminating (SIGINT) 23:43:00.520069 run patchelf(pid=14475): Terminated: ok {rc=0} 23:43:00.640874 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14472): Process ended prematurely: osmo-stp_10.42.42.5(pid=14472) [trial-2396↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14472)] [trial-2396↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 23:43:00.650452 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 23:43:00.677143 run osmo-hlr_10.42.42.2(pid=14469): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14469)] 23:43:00.724251 run osmo-hlr_10.42.42.2(pid=14469): stdout: | (launched: 2022-12-13_23:42:57.565626) 23:43:00.773164 run osmo-hlr_10.42.42.2(pid=14469): stderr: | [0;m[1;31m20221213234257741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234257741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234257741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234257741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234257741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234257741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234257753 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234257762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234257762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234257762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:00.822485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14462): Terminating (SIGTERM) 23:43:00.883832 run iperf3-srv_10.42.42.10(pid=14463): Terminating (SIGTERM) 23:43:00.925266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14464): Terminating (SIGTERM) 23:43:00.966272 run iperf3-srv_10.42.42.10(pid=14465): Terminating (SIGTERM) 23:43:01.006522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14468): Terminating (SIGTERM) 23:43:01.047577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14471): Terminating (SIGTERM) 23:43:01.087699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14474): Terminating (SIGTERM) 23:43:01.128556 --- ParallelTerminationStrategy: PID 14462 died... 23:43:01.148008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14462): Terminated: ok {rc=0} 23:43:01.193796 --- ParallelTerminationStrategy: PID 14463 died... 23:43:01.212750 run iperf3-srv_10.42.42.10(pid=14463): Terminated {rc=256} 23:43:01.256833 --- ParallelTerminationStrategy: PID 14464 died... 23:43:01.276042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14464): Terminated: ok {rc=0} 23:43:01.320095 --- ParallelTerminationStrategy: PID 14465 died... 23:43:01.338857 run iperf3-srv_10.42.42.10(pid=14465): Terminated {rc=256} 23:43:01.382879 --- ParallelTerminationStrategy: PID 14468 died... 23:43:01.401686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14468): Terminated: ok {rc=0} 23:43:01.445894 --- ParallelTerminationStrategy: PID 14471 died... 23:43:01.464804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14471): Terminated: ok {rc=0} 23:43:01.509234 --- ParallelTerminationStrategy: PID 14474 died... 23:43:01.528419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14474): Terminated: ok {rc=0} 23:43:01.615412 bus /gobi_0: Setting Powered False 23:43:02.717849 bus /gobi_0: Setting Powered False 23:43:03.834491 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 23:43:04.983092 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:04.995068 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:43:05.048528 tst iperf3.py: using LAC 37047 23:43:05.173932 tst iperf3.py: using RAC 72 23:43:05.298811 tst iperf3.py: using CellId 37047 23:43:05.426007 tst iperf3.py: using BVCI 37048 23:43:05.543825 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:05.555046 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:05.566115 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:05.577081 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:05.588812 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:05.600155 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:05.611785 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:05.623151 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:05.634665 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:05.752651 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:43:05.968303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:06.287460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14476): Launched 23:43:06.563431 run iperf3-srv_10.42.42.10(pid=14477): Launched 23:43:06.682867 tst iperf3.py:8: start network... 23:43:06.898179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:07.392070 run create_hlr_db(pid=14478): Launched 23:43:07.513953 bus /gobi_6: Setting Powered False 23:43:08.577500 run create_hlr_db(pid=14478): Terminated: ok {rc=0} 23:43:09.020668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14480): Launched 23:43:09.339501 run osmo-hlr_10.42.42.2(pid=14481): Launched 23:43:09.461787 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:10.010664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14483): Launched 23:43:10.329170 run osmo-stp_10.42.42.5(pid=14484): Launched 23:43:10.451298 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:11.002116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14486): Launched 23:43:11.123439 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:11.393833 run patchelf(pid=14487): Launched 23:43:11.570862 run osmo-stp_10.42.42.5(pid=14484): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14484)] 23:43:11.706728 run osmo-stp_10.42.42.5(pid=14484): stdout: | (launched: 2022-12-13_23:43:10.271415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:11.844010 run osmo-stp_10.42.42.5(pid=14484): stderr: | [0;m[38;5;43m20221213234310462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234310462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234310462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234310463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234310463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234310463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234310463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:11.981550 run osmo-stp_10.42.42.5(pid=14484): stdout: | (launched: 2022-12-13_23:43:10.271415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:12.112551 run osmo-stp_10.42.42.5(pid=14484): stderr: | [0;m[38;5;43m20221213234310462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234310462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234310462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234310463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234310463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234310463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234310463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:12.268502 run patchelf(pid=14487): Terminating (SIGINT) 23:43:12.448483 run patchelf(pid=14487): Terminated: ok {rc=0} 23:43:12.578135 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14484): Process ended prematurely: osmo-stp_10.42.42.5(pid=14484) [trial-2396↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14484)] [trial-2396↪gprs:trx-sysmocell5000↪iperf3.py:8] 23:43:12.588290 tst iperf3.py:8: Test FAILED (7.6 sec) 23:43:12.616795 run osmo-hlr_10.42.42.2(pid=14481): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14481)] 23:43:12.667883 run osmo-hlr_10.42.42.2(pid=14481): stdout: | (launched: 2022-12-13_23:43:09.282146) 23:43:12.720765 run osmo-hlr_10.42.42.2(pid=14481): stderr: | [0;m[1;31m20221213234309481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234309481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234309482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234309482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234309482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234309482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234309494 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234309503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234309503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234309503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:12.773957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14476): Terminating (SIGTERM) 23:43:12.816099 run iperf3-srv_10.42.42.10(pid=14477): Terminating (SIGTERM) 23:43:12.858836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14480): Terminating (SIGTERM) 23:43:12.901268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14483): Terminating (SIGTERM) 23:43:12.943926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14486): Terminating (SIGTERM) 23:43:12.986578 --- ParallelTerminationStrategy: PID 14476 died... 23:43:13.007061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14476): Terminated: ok {rc=0} 23:43:13.054036 --- ParallelTerminationStrategy: PID 14477 died... 23:43:13.073881 run iperf3-srv_10.42.42.10(pid=14477): Terminated {rc=256} 23:43:13.120214 --- ParallelTerminationStrategy: PID 14480 died... 23:43:13.140158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14480): Terminated: ok {rc=0} 23:43:13.187003 --- ParallelTerminationStrategy: PID 14483 died... 23:43:13.206952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14483): Terminated: ok {rc=0} 23:43:13.253588 --- ParallelTerminationStrategy: PID 14486 died... 23:43:13.273498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14486): Terminated: ok {rc=0} 23:43:13.361829 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 23:43:14.513118 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:14.524713 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:43:14.577449 tst iperf3m4.py: using LAC 37048 23:43:14.701310 tst iperf3m4.py: using RAC 73 23:43:14.824159 tst iperf3m4.py: using CellId 37048 23:43:14.948689 tst iperf3m4.py: using BVCI 37049 23:43:15.064440 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:15.075658 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:15.086746 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:15.097836 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:15.108936 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:15.120078 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:15.131517 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:15.142867 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:15.154279 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:15.271428 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:15.390100 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:15.508297 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:15.625440 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:43:15.827145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:16.169781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14488): Launched 23:43:16.454793 run iperf3-srv_10.42.42.10(pid=14489): Launched 23:43:16.580296 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:43:16.813461 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:17.197743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14490): Launched 23:43:17.463813 run iperf3-srv_10.42.42.10(pid=14491): Launched 23:43:17.575257 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:43:17.774783 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:18.073018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14492): Launched 23:43:18.331346 run iperf3-srv_10.42.42.10(pid=14493): Launched 23:43:18.442331 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:43:18.641401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:18.939375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14494): Launched 23:43:19.197504 run iperf3-srv_10.42.42.10(pid=14495): Launched 23:43:19.308455 tst iperf3m4.py:8: start network... 23:43:19.507381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:19.967842 run create_hlr_db(pid=14496): Launched 23:43:20.089988 bus /gobi_6: Setting Powered False 23:43:21.149599 run create_hlr_db(pid=14496): Terminated: ok {rc=0} 23:43:21.566087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14498): Launched 23:43:21.863478 run osmo-hlr_10.42.42.2(pid=14499): Launched 23:43:21.976811 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:22.505973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14501): Launched 23:43:22.803672 run osmo-stp_10.42.42.5(pid=14502): Launched 23:43:22.916555 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:23.433666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14504): Launched 23:43:23.546858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:23.798567 run patchelf(pid=14505): Launched 23:43:23.964334 run osmo-stp_10.42.42.5(pid=14502): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14502)] 23:43:24.090485 run osmo-stp_10.42.42.5(pid=14502): stdout: | (launched: 2022-12-13_23:43:22.749422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:24.218342 run osmo-stp_10.42.42.5(pid=14502): stderr: | [0;m[38;5;43m20221213234322920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234322920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234322920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234322921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234322921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234322921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234322921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:24.345933 run osmo-stp_10.42.42.5(pid=14502): stdout: | (launched: 2022-12-13_23:43:22.749422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:24.467870 run osmo-stp_10.42.42.5(pid=14502): stderr: | [0;m[38;5;43m20221213234322920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234322920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234322920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234322921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234322921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234322921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234322921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:24.612217 run patchelf(pid=14505): Terminating (SIGINT) 23:43:24.779198 run patchelf(pid=14505): Terminated: ok {rc=0} 23:43:24.899545 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14502): Process ended prematurely: osmo-stp_10.42.42.5(pid=14502) [trial-2396↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14502)] [trial-2396↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 23:43:24.908864 tst iperf3m4.py:8: Test FAILED (10.4 sec) 23:43:24.935856 run osmo-hlr_10.42.42.2(pid=14499): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14499)] 23:43:24.983120 run osmo-hlr_10.42.42.2(pid=14499): stdout: | (launched: 2022-12-13_23:43:21.808907) 23:43:25.032072 run osmo-hlr_10.42.42.2(pid=14499): stderr: | [0;m[1;31m20221213234321985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234321985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234321985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234321985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234321985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234321985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234321998 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234322007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234322007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234322008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:25.081438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14488): Terminating (SIGTERM) 23:43:25.120466 run iperf3-srv_10.42.42.10(pid=14489): Terminating (SIGTERM) 23:43:25.159446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14490): Terminating (SIGTERM) 23:43:25.198421 run iperf3-srv_10.42.42.10(pid=14491): Terminating (SIGTERM) 23:43:25.237372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14492): Terminating (SIGTERM) 23:43:25.276258 run iperf3-srv_10.42.42.10(pid=14493): Terminating (SIGTERM) 23:43:25.314998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14494): Terminating (SIGTERM) 23:43:25.353968 run iperf3-srv_10.42.42.10(pid=14495): Terminating (SIGTERM) 23:43:25.392780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14498): Terminating (SIGTERM) 23:43:25.431750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14501): Terminating (SIGTERM) 23:43:25.470800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14504): Terminating (SIGTERM) 23:43:25.510115 --- ParallelTerminationStrategy: PID 14488 died... 23:43:25.529029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14488): Terminated: ok {rc=0} 23:43:25.572355 --- ParallelTerminationStrategy: PID 14489 died... 23:43:25.590705 run iperf3-srv_10.42.42.10(pid=14489): Terminated {rc=256} 23:43:25.633598 --- ParallelTerminationStrategy: PID 14490 died... 23:43:25.651796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14490): Terminated: ok {rc=0} 23:43:25.694884 --- ParallelTerminationStrategy: PID 14491 died... 23:43:25.713171 run iperf3-srv_10.42.42.10(pid=14491): Terminated {rc=256} 23:43:25.756644 --- ParallelTerminationStrategy: PID 14492 died... 23:43:25.775100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14492): Terminated: ok {rc=0} 23:43:25.818284 --- ParallelTerminationStrategy: PID 14493 died... 23:43:25.836598 run iperf3-srv_10.42.42.10(pid=14493): Terminated {rc=256} 23:43:25.879513 --- ParallelTerminationStrategy: PID 14494 died... 23:43:25.897892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14494): Terminated: ok {rc=0} 23:43:25.941048 --- ParallelTerminationStrategy: PID 14495 died... 23:43:25.959363 run iperf3-srv_10.42.42.10(pid=14495): Terminated {rc=256} 23:43:26.002488 --- ParallelTerminationStrategy: PID 14498 died... 23:43:26.020757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14498): Terminated: ok {rc=0} 23:43:26.063747 --- ParallelTerminationStrategy: PID 14501 died... 23:43:26.082042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14501): Terminated: ok {rc=0} 23:43:26.125274 --- ParallelTerminationStrategy: PID 14504 died... 23:43:26.143466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14504): Terminated: ok {rc=0} 23:43:26.228879 bus /gobi_4: Setting Powered False 23:43:27.326471 bus /gobi_4: Setting Powered False 23:43:28.439865 bus /gobi_1: Setting Powered False 23:43:29.537341 bus /gobi_1: Setting Powered False 23:43:30.655219 bus /gobi_0: Setting Powered False 23:43:31.752695 bus /gobi_0: Setting Powered False 23:43:32.869356 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 23:43:33.973238 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:33.984895 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:43:34.036072 tst ping.py: using LAC 37049 23:43:34.152320 tst ping.py: using RAC 74 23:43:34.268075 tst ping.py: using CellId 37049 23:43:34.383340 tst ping.py: using BVCI 37050 23:43:34.489466 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:34.500136 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:34.510925 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:34.521559 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:34.532328 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:34.543213 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:34.553695 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:34.564548 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:34.682221 tst ping.py:19: start network... 23:43:34.894172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:35.377952 run create_hlr_db(pid=14506): Launched 23:43:35.496800 bus /gobi_6: Setting Powered False 23:43:36.559109 run create_hlr_db(pid=14506): Terminated: ok {rc=0} 23:43:36.979300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14508): Launched 23:43:37.271283 run osmo-hlr_10.42.42.2(pid=14509): Launched 23:43:37.383275 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:37.889146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14511): Launched 23:43:38.179619 run osmo-stp_10.42.42.5(pid=14512): Launched 23:43:38.289468 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:38.794694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14514): Launched 23:43:38.906052 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:39.152179 run patchelf(pid=14515): Launched 23:43:39.314170 run osmo-stp_10.42.42.5(pid=14512): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14512)] 23:43:39.437535 run osmo-stp_10.42.42.5(pid=14512): stdout: | (launched: 2022-12-13_23:43:38.126367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:39.562523 run osmo-stp_10.42.42.5(pid=14512): stderr: | [0;m[38;5;43m20221213234338297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234338297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234338297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234338298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234338298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234338298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234338298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:39.687851 run osmo-stp_10.42.42.5(pid=14512): stdout: | (launched: 2022-12-13_23:43:38.126367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:39.807338 run osmo-stp_10.42.42.5(pid=14512): stderr: | [0;m[38;5;43m20221213234338297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234338297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234338297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234338298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234338298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234338298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234338298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:39.949753 run patchelf(pid=14515): Terminating (SIGINT) 23:43:40.112883 run patchelf(pid=14515): Terminated: ok {rc=0} 23:43:40.230847 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14512): Process ended prematurely: osmo-stp_10.42.42.5(pid=14512) [trial-2396↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14512)] [trial-2396↪gprs:trx-sysmocell5000↪ping.py:22] 23:43:40.239384 tst ping.py:22: Test FAILED (6.3 sec) 23:43:40.265790 run osmo-hlr_10.42.42.2(pid=14509): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14509)] 23:43:40.314115 run osmo-hlr_10.42.42.2(pid=14509): stdout: | (launched: 2022-12-13_23:43:37.217997) 23:43:40.363557 run osmo-hlr_10.42.42.2(pid=14509): stderr: | [0;m[1;31m20221213234337392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234337392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234337392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234337392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234337392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234337392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234337409 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234337418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234337418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234337418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:40.413204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14508): Terminating (SIGTERM) 23:43:40.453000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14511): Terminating (SIGTERM) 23:43:40.492423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14514): Terminating (SIGTERM) 23:43:40.532007 --- ParallelTerminationStrategy: PID 14508 died... 23:43:40.551105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14508): Terminated: ok {rc=0} 23:43:40.595040 --- ParallelTerminationStrategy: PID 14511 died... 23:43:40.613708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14511): Terminated: ok {rc=0} 23:43:40.657327 --- ParallelTerminationStrategy: PID 14514 died... 23:43:40.675914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14514): Terminated: ok {rc=0} 23:43:40.760765 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 23:43:41.847855 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:41.859033 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:43:41.909807 tst ping_idle_ping.py: using LAC 37050 23:43:42.027537 tst ping_idle_ping.py: using RAC 75 23:43:42.144621 tst ping_idle_ping.py: using CellId 37050 23:43:42.260293 tst ping_idle_ping.py: using BVCI 37051 23:43:42.366926 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:42.377695 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:42.388123 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:42.398615 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:42.409023 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:42.421076 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:42.432388 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:42.443551 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:42.562239 tst ping_idle_ping.py:24: start network... 23:43:42.759164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:43.214292 run create_hlr_db(pid=14516): Launched 23:43:43.333875 bus /gobi_6: Setting Powered False 23:43:44.395888 run create_hlr_db(pid=14516): Terminated: ok {rc=0} 23:43:44.833696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14518): Launched 23:43:45.146298 run osmo-hlr_10.42.42.2(pid=14519): Launched 23:43:45.266693 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:45.808325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14521): Launched 23:43:46.169699 run osmo-stp_10.42.42.5(pid=14522): Launched 23:43:46.416123 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:46.998010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14524): Launched 23:43:47.149160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:47.424488 run patchelf(pid=14525): Launched 23:43:47.599144 run osmo-stp_10.42.42.5(pid=14522): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14522)] 23:43:47.732571 run osmo-stp_10.42.42.5(pid=14522): stdout: | (launched: 2022-12-13_23:43:46.101405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:47.867513 run osmo-stp_10.42.42.5(pid=14522): stderr: | [0;m[38;5;43m20221213234346369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234346369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234346370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234346370 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234346370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234346371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234346371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:48.002942 run osmo-stp_10.42.42.5(pid=14522): stdout: | (launched: 2022-12-13_23:43:46.101405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:48.132288 run osmo-stp_10.42.42.5(pid=14522): stderr: | [0;m[38;5;43m20221213234346369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234346369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234346370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234346370 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234346370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234346371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234346371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:48.285969 run patchelf(pid=14525): Terminating (SIGINT) 23:43:48.462234 run patchelf(pid=14525): Terminated: ok {rc=0} 23:43:48.589130 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14522): Process ended prematurely: osmo-stp_10.42.42.5(pid=14522) [trial-2396↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14522)] [trial-2396↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 23:43:48.598578 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 23:43:48.626340 run osmo-hlr_10.42.42.2(pid=14519): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14519)] 23:43:48.677101 run osmo-hlr_10.42.42.2(pid=14519): stdout: | (launched: 2022-12-13_23:43:45.089479) 23:43:48.729209 run osmo-hlr_10.42.42.2(pid=14519): stderr: | [0;m[1;31m20221213234345286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234345286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234345286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234345286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234345286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234345286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234345298 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234345306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234345306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234345306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:48.781709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14518): Terminating (SIGTERM) 23:43:48.823650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14521): Terminating (SIGTERM) 23:43:48.865683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14524): Terminating (SIGTERM) 23:43:48.908263 --- ParallelTerminationStrategy: PID 14518 died... 23:43:48.928528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14518): Terminated: ok {rc=0} 23:43:48.974900 --- ParallelTerminationStrategy: PID 14521 died... 23:43:48.994696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14521): Terminated: ok {rc=0} 23:43:49.040931 --- ParallelTerminationStrategy: PID 14524 died... 23:43:49.060757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14524): Terminated: ok {rc=0} 23:43:49.148284 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 23:43:50.462652 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:43:50.469365 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:43:50.502639 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:43:50.541630 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:43:50.626628 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:43:50.659283 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:43:50.697177 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:43:51.293132 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:43:51.340895 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:51.352045 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:43:51.401963 tst cs_paging_gprs_active.py: using LAC 37051 23:43:51.519935 tst cs_paging_gprs_active.py: using RAC 76 23:43:51.643970 tst cs_paging_gprs_active.py: using CellId 37051 23:43:51.773768 tst cs_paging_gprs_active.py: using BVCI 37052 23:43:51.883748 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:51.894773 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:51.905676 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:51.916443 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:51.927175 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:51.938438 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:51.952992 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:51.964607 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:51.976460 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:43:52.094391 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:43:52.213067 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:43:52.429648 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:52.749347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14530): Launched 23:43:53.025681 run iperf3-srv_10.42.42.10(pid=14531): Launched 23:43:53.144932 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:43:53.361134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:53.681144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14532): Launched 23:43:53.957671 run iperf3-srv_10.42.42.10(pid=14533): Launched 23:43:54.077129 tst cs_paging_gprs_active.py:38: start network... 23:43:54.293394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:54.786524 run create_hlr_db(pid=14534): Launched 23:43:54.907917 bus /gobi_6: Setting Powered False 23:43:55.970342 run create_hlr_db(pid=14534): Terminated: ok {rc=0} 23:43:56.397520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14536): Launched 23:43:56.696578 run osmo-hlr_10.42.42.2(pid=14537): Launched 23:43:56.812234 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:57.339038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14539): Launched 23:43:57.638392 run osmo-stp_10.42.42.5(pid=14540): Launched 23:43:57.753190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:58.269109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14542): Launched 23:43:58.384160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:58.636397 run patchelf(pid=14543): Launched 23:43:58.802790 run osmo-stp_10.42.42.5(pid=14540): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14540)] 23:43:58.929477 run osmo-stp_10.42.42.5(pid=14540): stdout: | (launched: 2022-12-13_23:43:57.583996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:59.057688 run osmo-stp_10.42.42.5(pid=14540): stderr: | [0;m[38;5;43m20221213234357752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234357753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234357753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234357753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234357754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234357754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234357754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:59.186454 run osmo-stp_10.42.42.5(pid=14540): stdout: | (launched: 2022-12-13_23:43:57.583996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:59.308805 run osmo-stp_10.42.42.5(pid=14540): stderr: | [0;m[38;5;43m20221213234357752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234357753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234357753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234357753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234357754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234357754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234357754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:59.454441 run patchelf(pid=14543): Terminating (SIGINT) 23:43:59.621243 run patchelf(pid=14543): Terminated: ok {rc=0} 23:43:59.742158 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14540): Process ended prematurely: osmo-stp_10.42.42.5(pid=14540) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14540)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:43:59.751497 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 23:43:59.778104 run osmo-hlr_10.42.42.2(pid=14537): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14537)] 23:43:59.825145 run osmo-hlr_10.42.42.2(pid=14537): stdout: | (launched: 2022-12-13_23:43:56.642442) 23:43:59.873732 run osmo-hlr_10.42.42.2(pid=14537): stderr: | [0;m[1;31m20221213234356818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234356818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234356818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234356818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234356818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234356819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234356832 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234356842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234356842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234356843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:59.922986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14530): Terminating (SIGTERM) 23:43:59.962251 run iperf3-srv_10.42.42.10(pid=14531): Terminating (SIGTERM) 23:44:00.001358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14532): Terminating (SIGTERM) 23:44:00.041869 run iperf3-srv_10.42.42.10(pid=14533): Terminating (SIGTERM) 23:44:00.081261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14536): Terminating (SIGTERM) 23:44:00.120512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14539): Terminating (SIGTERM) 23:44:00.159819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14542): Terminating (SIGTERM) 23:44:00.199298 --- ParallelTerminationStrategy: PID 14530 died... 23:44:00.218321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14530): Terminated: ok {rc=0} 23:44:00.261839 --- ParallelTerminationStrategy: PID 14531 died... 23:44:00.280153 run iperf3-srv_10.42.42.10(pid=14531): Terminated {rc=256} 23:44:00.323655 --- ParallelTerminationStrategy: PID 14532 died... 23:44:00.342215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14532): Terminated: ok {rc=0} 23:44:00.385446 --- ParallelTerminationStrategy: PID 14533 died... 23:44:00.403834 run iperf3-srv_10.42.42.10(pid=14533): Terminated {rc=256} 23:44:00.447246 --- ParallelTerminationStrategy: PID 14536 died... 23:44:00.465678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14536): Terminated: ok {rc=0} 23:44:00.508809 --- ParallelTerminationStrategy: PID 14539 died... 23:44:00.527714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14539): Terminated: ok {rc=0} 23:44:00.570784 --- ParallelTerminationStrategy: PID 14542 died... 23:44:00.589210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14542): Terminated: ok {rc=0} 23:44:00.673565 bus /gobi_0: Setting Powered False 23:44:01.780787 bus /gobi_0: Setting Powered False 23:44:02.905655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:44:04.047910 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:04.059664 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:44:04.113437 tst iperf3.py: using LAC 37052 23:44:04.241208 tst iperf3.py: using RAC 77 23:44:04.359196 tst iperf3.py: using CellId 37052 23:44:04.477183 tst iperf3.py: using BVCI 37053 23:44:04.585479 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:04.596513 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:04.607409 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:04.618366 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:04.629185 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:04.639819 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:04.651318 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:04.662249 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:04.673450 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:04.786780 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:44:04.987739 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:05.286174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14544): Launched 23:44:05.544271 run iperf3-srv_10.42.42.10(pid=14545): Launched 23:44:05.656146 tst iperf3.py:8: start network... 23:44:05.855672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:06.316527 run create_hlr_db(pid=14546): Launched 23:44:06.437529 bus /gobi_6: Setting Powered False 23:44:07.497461 run create_hlr_db(pid=14546): Terminated: ok {rc=0} 23:44:07.932595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14548): Launched 23:44:08.250234 run osmo-hlr_10.42.42.2(pid=14549): Launched 23:44:08.371834 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:08.919589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14551): Launched 23:44:09.237643 run osmo-stp_10.42.42.5(pid=14552): Launched 23:44:09.360438 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:09.908784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14554): Launched 23:44:10.030504 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:10.299046 run patchelf(pid=14555): Launched 23:44:10.475324 run osmo-stp_10.42.42.5(pid=14552): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14552)] 23:44:10.609611 run osmo-stp_10.42.42.5(pid=14552): stdout: | (launched: 2022-12-13_23:44:09.179851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:10.745537 run osmo-stp_10.42.42.5(pid=14552): stderr: | [0;m[38;5;43m20221213234409371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234409371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234409372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234409372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234409373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234409373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234409373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:10.881340 run osmo-stp_10.42.42.5(pid=14552): stdout: | (launched: 2022-12-13_23:44:09.179851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:11.011086 run osmo-stp_10.42.42.5(pid=14552): stderr: | [0;m[38;5;43m20221213234409371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234409371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234409372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234409372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234409373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234409373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234409373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:11.165333 run patchelf(pid=14555): Terminating (SIGINT) 23:44:11.343939 run patchelf(pid=14555): Terminated: ok {rc=0} 23:44:11.472421 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14552): Process ended prematurely: osmo-stp_10.42.42.5(pid=14552) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14552)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 23:44:11.482703 tst iperf3.py:8: Test FAILED (7.5 sec) 23:44:11.510784 run osmo-hlr_10.42.42.2(pid=14549): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14549)] 23:44:11.561242 run osmo-hlr_10.42.42.2(pid=14549): stdout: | (launched: 2022-12-13_23:44:08.192347) 23:44:11.613145 run osmo-hlr_10.42.42.2(pid=14549): stderr: | [0;m[1;31m20221213234408390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234408390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234408390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234408390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234408390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234408390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234408401 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234408410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234408410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234408410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:11.665373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14544): Terminating (SIGTERM) 23:44:11.706988 run iperf3-srv_10.42.42.10(pid=14545): Terminating (SIGTERM) 23:44:11.748709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14548): Terminating (SIGTERM) 23:44:11.791070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14551): Terminating (SIGTERM) 23:44:11.833394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14554): Terminating (SIGTERM) 23:44:11.875351 --- ParallelTerminationStrategy: PID 14544 died... 23:44:11.915736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14544): Terminated: ok {rc=0} 23:44:11.966682 --- ParallelTerminationStrategy: PID 14545 died... 23:44:11.986444 run iperf3-srv_10.42.42.10(pid=14545): Terminated {rc=256} 23:44:12.032325 --- ParallelTerminationStrategy: PID 14548 died... 23:44:12.051944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14548): Terminated: ok {rc=0} 23:44:12.097761 --- ParallelTerminationStrategy: PID 14551 died... 23:44:12.117473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14551): Terminated: ok {rc=0} 23:44:12.163644 --- ParallelTerminationStrategy: PID 14554 died... 23:44:12.183399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14554): Terminated: ok {rc=0} 23:44:12.271698 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:44:13.423662 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:13.435627 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:44:13.487666 tst iperf3m4.py: using LAC 37053 23:44:13.614426 tst iperf3m4.py: using RAC 78 23:44:13.740904 tst iperf3m4.py: using CellId 37053 23:44:13.865423 tst iperf3m4.py: using BVCI 37054 23:44:13.975997 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:13.987163 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:13.998121 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:14.009168 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:14.020204 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:14.031312 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:14.042364 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:14.053349 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:14.064370 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:14.182815 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:14.301897 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:14.422904 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:14.540826 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:44:14.742281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:15.041710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14556): Launched 23:44:15.301582 run iperf3-srv_10.42.42.10(pid=14557): Launched 23:44:15.413952 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:44:15.614771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:15.935928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14558): Launched 23:44:16.246702 run iperf3-srv_10.42.42.10(pid=14559): Launched 23:44:16.399637 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:44:16.604471 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:16.913019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14560): Launched 23:44:17.197112 run iperf3-srv_10.42.42.10(pid=14561): Launched 23:44:17.314448 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:44:17.515114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:17.815273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14562): Launched 23:44:18.075004 run iperf3-srv_10.42.42.10(pid=14563): Launched 23:44:18.187566 tst iperf3m4.py:8: start network... 23:44:18.388099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:18.848814 run create_hlr_db(pid=14564): Launched 23:44:18.970670 bus /gobi_6: Setting Powered False 23:44:20.029827 run create_hlr_db(pid=14564): Terminated: ok {rc=0} 23:44:20.466554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14566): Launched 23:44:20.784380 run osmo-hlr_10.42.42.2(pid=14567): Launched 23:44:20.905754 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:21.458721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14569): Launched 23:44:21.777294 run osmo-stp_10.42.42.5(pid=14570): Launched 23:44:21.898484 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:22.447912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14572): Launched 23:44:22.570800 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:22.839879 run patchelf(pid=14573): Launched 23:44:23.017060 run osmo-stp_10.42.42.5(pid=14570): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14570)] 23:44:23.152307 run osmo-stp_10.42.42.5(pid=14570): stdout: | (launched: 2022-12-13_23:44:21.718920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:23.289648 run osmo-stp_10.42.42.5(pid=14570): stderr: | [0;m[38;5;43m20221213234421911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234421911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234421912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234421912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234421913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234421913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234421913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:23.426320 run osmo-stp_10.42.42.5(pid=14570): stdout: | (launched: 2022-12-13_23:44:21.718920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:23.556898 run osmo-stp_10.42.42.5(pid=14570): stderr: | [0;m[38;5;43m20221213234421911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234421911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234421912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234421912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234421913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234421913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234421913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:23.711836 run patchelf(pid=14573): Terminating (SIGINT) 23:44:23.890919 run patchelf(pid=14573): Terminated: ok {rc=0} 23:44:24.020003 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14570): Process ended prematurely: osmo-stp_10.42.42.5(pid=14570) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14570)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 23:44:24.030127 tst iperf3m4.py:8: Test FAILED (10.6 sec) 23:44:24.058767 run osmo-hlr_10.42.42.2(pid=14567): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14567)] 23:44:24.109677 run osmo-hlr_10.42.42.2(pid=14567): stdout: | (launched: 2022-12-13_23:44:20.726712) 23:44:24.161619 run osmo-hlr_10.42.42.2(pid=14567): stderr: | [0;m[1;31m20221213234420925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234420925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234420925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234420925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234420925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234420925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234420938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234420946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234420946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234420946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:24.215000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14556): Terminating (SIGTERM) 23:44:24.257280 run iperf3-srv_10.42.42.10(pid=14557): Terminating (SIGTERM) 23:44:24.299939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14558): Terminating (SIGTERM) 23:44:24.342903 run iperf3-srv_10.42.42.10(pid=14559): Terminating (SIGTERM) 23:44:24.385309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14560): Terminating (SIGTERM) 23:44:24.427629 run iperf3-srv_10.42.42.10(pid=14561): Terminating (SIGTERM) 23:44:24.469719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14562): Terminating (SIGTERM) 23:44:24.512067 run iperf3-srv_10.42.42.10(pid=14563): Terminating (SIGTERM) 23:44:24.554285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14566): Terminating (SIGTERM) 23:44:24.596417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14569): Terminating (SIGTERM) 23:44:24.638603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14572): Terminating (SIGTERM) 23:44:24.681413 --- ParallelTerminationStrategy: PID 14556 died... 23:44:24.702026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14556): Terminated: ok {rc=0} 23:44:24.748724 --- ParallelTerminationStrategy: PID 14557 died... 23:44:24.768584 run iperf3-srv_10.42.42.10(pid=14557): Terminated {rc=256} 23:44:24.815186 --- ParallelTerminationStrategy: PID 14558 died... 23:44:24.835220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14558): Terminated: ok {rc=0} 23:44:24.881795 --- ParallelTerminationStrategy: PID 14559 died... 23:44:24.901699 run iperf3-srv_10.42.42.10(pid=14559): Terminated {rc=256} 23:44:24.948090 --- ParallelTerminationStrategy: PID 14560 died... 23:44:24.968096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14560): Terminated: ok {rc=0} 23:44:25.014622 --- ParallelTerminationStrategy: PID 14561 died... 23:44:25.034655 run iperf3-srv_10.42.42.10(pid=14561): Terminated {rc=256} 23:44:25.081080 --- ParallelTerminationStrategy: PID 14562 died... 23:44:25.101218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14562): Terminated: ok {rc=0} 23:44:25.147784 --- ParallelTerminationStrategy: PID 14563 died... 23:44:25.167605 run iperf3-srv_10.42.42.10(pid=14563): Terminated {rc=256} 23:44:25.214502 --- ParallelTerminationStrategy: PID 14566 died... 23:44:25.234485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14566): Terminated: ok {rc=0} 23:44:25.281510 --- ParallelTerminationStrategy: PID 14569 died... 23:44:25.301584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14569): Terminated: ok {rc=0} 23:44:25.347919 --- ParallelTerminationStrategy: PID 14572 died... 23:44:25.367967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14572): Terminated: ok {rc=0} 23:44:25.456229 bus /gobi_4: Setting Powered False 23:44:26.554537 bus /gobi_4: Setting Powered False 23:44:27.670049 bus /gobi_1: Setting Powered False 23:44:28.768349 bus /gobi_1: Setting Powered False 23:44:29.884066 bus /gobi_0: Setting Powered False 23:44:30.987131 bus /gobi_0: Setting Powered False 23:44:32.103735 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 23:44:33.207262 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:33.218820 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:44:33.267932 tst ping.py: using LAC 37054 23:44:33.383923 tst ping.py: using RAC 79 23:44:33.496841 tst ping.py: using CellId 37054 23:44:33.609882 tst ping.py: using BVCI 37055 23:44:33.715542 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:33.726529 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:33.737339 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:33.748024 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:33.758678 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:33.769733 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:33.780522 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:33.791725 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:33.903648 tst ping.py:19: start network... 23:44:34.098960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:34.551433 run create_hlr_db(pid=14574): Launched 23:44:34.671098 bus /gobi_6: Setting Powered False 23:44:35.729246 run create_hlr_db(pid=14574): Terminated: ok {rc=0} 23:44:36.156672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14576): Launched 23:44:36.469619 run osmo-hlr_10.42.42.2(pid=14577): Launched 23:44:36.590583 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:37.132355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14579): Launched 23:44:37.443599 run osmo-stp_10.42.42.5(pid=14580): Launched 23:44:37.564615 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:38.105716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14582): Launched 23:44:38.225980 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:38.490258 run patchelf(pid=14583): Launched 23:44:38.663690 run osmo-stp_10.42.42.5(pid=14580): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14580)] 23:44:38.795907 run osmo-stp_10.42.42.5(pid=14580): stdout: | (launched: 2022-12-13_23:44:37.387055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:38.929925 run osmo-stp_10.42.42.5(pid=14580): stderr: | [0;m[38;5;43m20221213234437576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234437576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234437576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234437577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234437577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234437577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234437577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:39.064152 run osmo-stp_10.42.42.5(pid=14580): stdout: | (launched: 2022-12-13_23:44:37.387055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:39.192524 run osmo-stp_10.42.42.5(pid=14580): stderr: | [0;m[38;5;43m20221213234437576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234437576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234437576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234437577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234437577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234437577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234437577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:39.345393 run patchelf(pid=14583): Terminating (SIGINT) 23:44:39.520621 run patchelf(pid=14583): Terminated: ok {rc=0} 23:44:39.646798 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14580): Process ended prematurely: osmo-stp_10.42.42.5(pid=14580) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14580)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 23:44:39.656140 tst ping.py:22: Test FAILED (6.4 sec) 23:44:39.684177 run osmo-hlr_10.42.42.2(pid=14577): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14577)] 23:44:39.734550 run osmo-hlr_10.42.42.2(pid=14577): stdout: | (launched: 2022-12-13_23:44:36.412827) 23:44:39.785938 run osmo-hlr_10.42.42.2(pid=14577): stderr: | [0;m[1;31m20221213234436610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234436610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234436610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234436610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234436610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234436610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234436622 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234436630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234436630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234436630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:39.837883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14576): Terminating (SIGTERM) 23:44:39.879581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14579): Terminating (SIGTERM) 23:44:39.921635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14582): Terminating (SIGTERM) 23:44:39.964484 --- ParallelTerminationStrategy: PID 14576 died... 23:44:39.984795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14576): Terminated: ok {rc=0} 23:44:40.031330 --- ParallelTerminationStrategy: PID 14579 died... 23:44:40.051270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14579): Terminated: ok {rc=0} 23:44:40.097728 --- ParallelTerminationStrategy: PID 14582 died... 23:44:40.117744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14582): Terminated: ok {rc=0} 23:44:40.206558 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:44:41.294073 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:41.306398 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:44:41.360904 tst ping_idle_ping.py: using LAC 37055 23:44:41.484898 tst ping_idle_ping.py: using RAC 80 23:44:41.608226 tst ping_idle_ping.py: using CellId 37055 23:44:41.731119 tst ping_idle_ping.py: using BVCI 37056 23:44:41.845329 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:41.856733 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:41.868134 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:41.879362 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:41.890988 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:41.902642 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:41.914596 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:41.926290 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:42.046353 tst ping_idle_ping.py:24: start network... 23:44:42.258515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:42.747144 run create_hlr_db(pid=14584): Launched 23:44:42.866794 bus /gobi_6: Setting Powered False 23:44:43.929575 run create_hlr_db(pid=14584): Terminated: ok {rc=0} 23:44:44.351743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14586): Launched 23:44:44.645356 run osmo-hlr_10.42.42.2(pid=14587): Launched 23:44:44.758096 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:45.264410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14589): Launched 23:44:45.557275 run osmo-stp_10.42.42.5(pid=14590): Launched 23:44:45.669915 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:46.231048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14592): Launched 23:44:46.352351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:46.615961 run patchelf(pid=14593): Launched 23:44:46.810376 run osmo-stp_10.42.42.5(pid=14590): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14590)] 23:44:46.938273 run osmo-stp_10.42.42.5(pid=14590): stdout: | (launched: 2022-12-13_23:44:45.503654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:47.067500 run osmo-stp_10.42.42.5(pid=14590): stderr: | [0;m[38;5;43m20221213234445672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234445672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234445673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234445673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234445674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234445674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234445674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:47.196658 run osmo-stp_10.42.42.5(pid=14590): stdout: | (launched: 2022-12-13_23:44:45.503654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:47.319245 run osmo-stp_10.42.42.5(pid=14590): stderr: | [0;m[38;5;43m20221213234445672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234445672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234445673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234445673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234445674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234445674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234445674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:47.462400 run patchelf(pid=14593): Terminating (SIGINT) 23:44:47.627298 run patchelf(pid=14593): Terminated: ok {rc=0} 23:44:47.746150 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14590): Process ended prematurely: osmo-stp_10.42.42.5(pid=14590) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14590)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 23:44:47.755097 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:44:47.781815 run osmo-hlr_10.42.42.2(pid=14587): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14587)] 23:44:47.829743 run osmo-hlr_10.42.42.2(pid=14587): stdout: | (launched: 2022-12-13_23:44:44.591750) 23:44:47.879318 run osmo-hlr_10.42.42.2(pid=14587): stderr: | [0;m[1;31m20221213234444763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234444763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234444763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234444763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234444763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234444763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234444779 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234444789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234444790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234444790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:47.929187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14586): Terminating (SIGTERM) 23:44:47.968660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14589): Terminating (SIGTERM) 23:44:48.008151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14592): Terminating (SIGTERM) 23:44:48.047870 --- ParallelTerminationStrategy: PID 14586 died... 23:44:48.067231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14586): Terminated: ok {rc=0} 23:44:48.111353 --- ParallelTerminationStrategy: PID 14589 died... 23:44:48.130200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14589): Terminated: ok {rc=0} 23:44:48.174234 --- ParallelTerminationStrategy: PID 14592 died... 23:44:48.192850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14592): Terminated: ok {rc=0} 23:44:48.278706 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:44:49.588208 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:44:49.595640 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:44:49.630955 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:44:49.670434 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:44:49.758632 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:44:49.792771 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:44:49.832169 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:44:50.430180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:44:50.481691 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:50.493047 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:44:50.564025 tst cs_paging_gprs_active.py: using LAC 37056 23:44:50.687145 tst cs_paging_gprs_active.py: using RAC 81 23:44:50.810864 tst cs_paging_gprs_active.py: using CellId 37056 23:44:50.934376 tst cs_paging_gprs_active.py: using BVCI 37057 23:44:51.051507 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:51.062900 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:51.074102 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:51.085484 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:51.096922 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:51.108347 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:51.119907 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:51.131308 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:51.142948 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:44:51.261350 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:44:51.378546 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:44:51.579553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:51.877635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14597): Launched 23:44:52.136799 run iperf3-srv_10.42.42.10(pid=14598): Launched 23:44:52.249169 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:44:52.450580 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:52.750367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14599): Launched 23:44:53.008679 run iperf3-srv_10.42.42.10(pid=14600): Launched 23:44:53.120387 tst cs_paging_gprs_active.py:38: start network... 23:44:53.319933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:53.779767 run create_hlr_db(pid=14601): Launched 23:44:53.901400 bus /gobi_6: Setting Powered False 23:44:54.961168 run create_hlr_db(pid=14601): Terminated: ok {rc=0} 23:44:55.376425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14603): Launched 23:44:55.673763 run osmo-hlr_10.42.42.2(pid=14604): Launched 23:44:55.786440 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:56.300309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14606): Launched 23:44:56.598031 run osmo-stp_10.42.42.5(pid=14607): Launched 23:44:56.711233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:57.224196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14609): Launched 23:44:57.339011 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:57.591055 run patchelf(pid=14610): Launched 23:44:57.756299 run osmo-stp_10.42.42.5(pid=14607): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14607)] 23:44:57.882464 run osmo-stp_10.42.42.5(pid=14607): stdout: | (launched: 2022-12-13_23:44:56.543912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:58.010621 run osmo-stp_10.42.42.5(pid=14607): stderr: | [0;m[38;5;43m20221213234456714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234456714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234456715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234456715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234456716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234456716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234456716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:58.138739 run osmo-stp_10.42.42.5(pid=14607): stdout: | (launched: 2022-12-13_23:44:56.543912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:58.262181 run osmo-stp_10.42.42.5(pid=14607): stderr: | [0;m[38;5;43m20221213234456714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234456714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234456715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234456715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234456716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234456716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234456716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:58.406456 run patchelf(pid=14610): Terminating (SIGINT) 23:44:58.574123 run patchelf(pid=14610): Terminated: ok {rc=0} 23:44:58.694440 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14607): Process ended prematurely: osmo-stp_10.42.42.5(pid=14607) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14607)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:44:58.703671 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 23:44:58.730230 run osmo-hlr_10.42.42.2(pid=14604): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14604)] 23:44:58.778328 run osmo-hlr_10.42.42.2(pid=14604): stdout: | (launched: 2022-12-13_23:44:55.619713) 23:44:58.827206 run osmo-hlr_10.42.42.2(pid=14604): stderr: | [0;m[1;31m20221213234455795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234455795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234455795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234455795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234455795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234455795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234455809 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234455817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234455818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234455818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:58.876479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14597): Terminating (SIGTERM) 23:44:58.915899 run iperf3-srv_10.42.42.10(pid=14598): Terminating (SIGTERM) 23:44:58.955139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14599): Terminating (SIGTERM) 23:44:58.994358 run iperf3-srv_10.42.42.10(pid=14600): Terminating (SIGTERM) 23:44:59.033765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14603): Terminating (SIGTERM) 23:44:59.073062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14606): Terminating (SIGTERM) 23:44:59.112348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14609): Terminating (SIGTERM) 23:44:59.151839 --- ParallelTerminationStrategy: PID 14597 died... 23:44:59.170360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14597): Terminated: ok {rc=0} 23:44:59.213752 --- ParallelTerminationStrategy: PID 14598 died... 23:44:59.231952 run iperf3-srv_10.42.42.10(pid=14598): Terminated {rc=256} 23:44:59.275313 --- ParallelTerminationStrategy: PID 14599 died... 23:44:59.293828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14599): Terminated: ok {rc=0} 23:44:59.336804 --- ParallelTerminationStrategy: PID 14600 died... 23:44:59.355137 run iperf3-srv_10.42.42.10(pid=14600): Terminated {rc=256} 23:44:59.398146 --- ParallelTerminationStrategy: PID 14603 died... 23:44:59.416500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14603): Terminated: ok {rc=0} 23:44:59.459572 --- ParallelTerminationStrategy: PID 14606 died... 23:44:59.478164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14606): Terminated: ok {rc=0} 23:44:59.521383 --- ParallelTerminationStrategy: PID 14609 died... 23:44:59.539813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14609): Terminated: ok {rc=0} 23:44:59.624050 bus /gobi_0: Setting Powered False 23:45:00.721721 bus /gobi_0: Setting Powered False 23:45:01.843442 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:45:02.991754 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:03.004016 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:45:03.084505 tst iperf3.py: using LAC 37057 23:45:03.208673 tst iperf3.py: using RAC 82 23:45:03.337075 tst iperf3.py: using CellId 37057 23:45:03.461289 tst iperf3.py: using BVCI 37058 23:45:03.576230 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:03.587738 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:03.599050 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:03.610331 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:03.621922 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:03.633470 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:03.644873 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:03.656366 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:03.668280 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:03.785598 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:45:03.987163 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:04.286189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14615): Launched 23:45:04.545517 run iperf3-srv_10.42.42.10(pid=14616): Launched 23:45:04.657477 tst iperf3.py:8: start network... 23:45:04.856403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:05.316087 run create_hlr_db(pid=14617): Launched 23:45:05.438639 bus /gobi_6: Setting Powered False 23:45:06.497652 run create_hlr_db(pid=14617): Terminated: ok {rc=0} 23:45:06.933083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14619): Launched 23:45:07.251198 run osmo-hlr_10.42.42.2(pid=14620): Launched 23:45:07.373376 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:07.925423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14622): Launched 23:45:08.241581 run osmo-stp_10.42.42.5(pid=14623): Launched 23:45:08.363366 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:08.910605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14625): Launched 23:45:09.031515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:09.300351 run patchelf(pid=14626): Launched 23:45:09.477557 run osmo-stp_10.42.42.5(pid=14623): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14623)] 23:45:09.612388 run osmo-stp_10.42.42.5(pid=14623): stdout: | (launched: 2022-12-13_23:45:08.184344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:09.749213 run osmo-stp_10.42.42.5(pid=14623): stderr: | [0;m[38;5;43m20221213234508374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234508374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234508374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234508374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234508375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234508375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234508375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:09.886057 run osmo-stp_10.42.42.5(pid=14623): stdout: | (launched: 2022-12-13_23:45:08.184344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:10.016763 run osmo-stp_10.42.42.5(pid=14623): stderr: | [0;m[38;5;43m20221213234508374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234508374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234508374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234508374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234508375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234508375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234508375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:10.171639 run patchelf(pid=14626): Terminating (SIGINT) 23:45:10.351606 run patchelf(pid=14626): Terminated: ok {rc=0} 23:45:10.480446 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14623): Process ended prematurely: osmo-stp_10.42.42.5(pid=14623) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14623)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 23:45:10.490555 tst iperf3.py:8: Test FAILED (7.5 sec) 23:45:10.518636 run osmo-hlr_10.42.42.2(pid=14620): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14620)] 23:45:10.569206 run osmo-hlr_10.42.42.2(pid=14620): stdout: | (launched: 2022-12-13_23:45:07.193239) 23:45:10.621438 run osmo-hlr_10.42.42.2(pid=14620): stderr: | [0;m[1;31m20221213234507389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234507389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234507389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234507389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234507389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234507389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234507401 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234507409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234507409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234507409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:10.673937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14615): Terminating (SIGTERM) 23:45:10.715736 run iperf3-srv_10.42.42.10(pid=14616): Terminating (SIGTERM) 23:45:10.757389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14619): Terminating (SIGTERM) 23:45:10.799181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14622): Terminating (SIGTERM) 23:45:10.840887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14625): Terminating (SIGTERM) 23:45:10.883468 --- ParallelTerminationStrategy: PID 14615 died... 23:45:10.903761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14615): Terminated: ok {rc=0} 23:45:10.950034 --- ParallelTerminationStrategy: PID 14616 died... 23:45:10.969643 run iperf3-srv_10.42.42.10(pid=14616): Terminated {rc=256} 23:45:11.015610 --- ParallelTerminationStrategy: PID 14619 died... 23:45:11.035611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14619): Terminated: ok {rc=0} 23:45:11.081495 --- ParallelTerminationStrategy: PID 14622 died... 23:45:11.101541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14622): Terminated: ok {rc=0} 23:45:11.147284 --- ParallelTerminationStrategy: PID 14625 died... 23:45:11.167020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14625): Terminated: ok {rc=0} 23:45:11.254673 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:45:12.406437 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:12.418419 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:45:12.490588 tst iperf3m4.py: using LAC 37058 23:45:12.620150 tst iperf3m4.py: using RAC 83 23:45:12.743749 tst iperf3m4.py: using CellId 37058 23:45:12.866265 tst iperf3m4.py: using BVCI 37059 23:45:12.981774 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:12.993305 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:13.004481 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:13.015732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:13.027178 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:13.038732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:13.050469 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:13.061935 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:13.073646 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:13.193922 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:13.311093 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:13.426438 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:13.545133 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:45:13.759181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:14.076082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14627): Launched 23:45:14.352173 run iperf3-srv_10.42.42.10(pid=14628): Launched 23:45:14.471177 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:45:14.685618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:15.004062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14629): Launched 23:45:15.279615 run iperf3-srv_10.42.42.10(pid=14630): Launched 23:45:15.398572 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:45:15.612537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:15.936440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14631): Launched 23:45:16.267293 run iperf3-srv_10.42.42.10(pid=14632): Launched 23:45:16.402128 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:45:16.612395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:16.933482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14633): Launched 23:45:17.223433 run iperf3-srv_10.42.42.10(pid=14634): Launched 23:45:17.343182 tst iperf3m4.py:8: start network... 23:45:17.557560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:18.049073 run create_hlr_db(pid=14635): Launched 23:45:18.170400 bus /gobi_6: Setting Powered False 23:45:19.233915 run create_hlr_db(pid=14635): Terminated: ok {rc=0} 23:45:19.659805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14637): Launched 23:45:19.959682 run osmo-hlr_10.42.42.2(pid=14638): Launched 23:45:20.074371 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:20.601855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14640): Launched 23:45:20.920255 run osmo-stp_10.42.42.5(pid=14641): Launched 23:45:21.041643 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:21.590606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14643): Launched 23:45:21.712478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:21.982191 run patchelf(pid=14644): Launched 23:45:22.159945 run osmo-stp_10.42.42.5(pid=14641): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14641)] 23:45:22.295751 run osmo-stp_10.42.42.5(pid=14641): stdout: | (launched: 2022-12-13_23:45:20.862777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:22.433346 run osmo-stp_10.42.42.5(pid=14641): stderr: | [0;m[38;5;43m20221213234521057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234521057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234521057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234521057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234521058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234521058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234521058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:22.570474 run osmo-stp_10.42.42.5(pid=14641): stdout: | (launched: 2022-12-13_23:45:20.862777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:22.701578 run osmo-stp_10.42.42.5(pid=14641): stderr: | [0;m[38;5;43m20221213234521057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234521057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234521057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234521057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234521058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234521058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234521058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:22.856759 run patchelf(pid=14644): Terminating (SIGINT) 23:45:23.036173 run patchelf(pid=14644): Terminated: ok {rc=0} 23:45:23.165359 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14641): Process ended prematurely: osmo-stp_10.42.42.5(pid=14641) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14641)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:45:23.175492 tst iperf3m4.py:8: Test FAILED (10.8 sec) 23:45:23.204470 run osmo-hlr_10.42.42.2(pid=14638): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14638)] 23:45:23.255904 run osmo-hlr_10.42.42.2(pid=14638): stdout: | (launched: 2022-12-13_23:45:19.905086) 23:45:23.309091 run osmo-hlr_10.42.42.2(pid=14638): stderr: | [0;m[1;31m20221213234520081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234520081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234520081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234520081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234520081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234520081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234520093 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234520102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234520102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234520102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:23.362168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14627): Terminating (SIGTERM) 23:45:23.404661 run iperf3-srv_10.42.42.10(pid=14628): Terminating (SIGTERM) 23:45:23.447584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14629): Terminating (SIGTERM) 23:45:23.490595 run iperf3-srv_10.42.42.10(pid=14630): Terminating (SIGTERM) 23:45:23.533259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14631): Terminating (SIGTERM) 23:45:23.576057 run iperf3-srv_10.42.42.10(pid=14632): Terminating (SIGTERM) 23:45:23.619168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14633): Terminating (SIGTERM) 23:45:23.661904 run iperf3-srv_10.42.42.10(pid=14634): Terminating (SIGTERM) 23:45:23.704458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14637): Terminating (SIGTERM) 23:45:23.747081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14640): Terminating (SIGTERM) 23:45:23.789598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14643): Terminating (SIGTERM) 23:45:23.832842 --- ParallelTerminationStrategy: PID 14627 died... 23:45:23.853580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14627): Terminated: ok {rc=0} 23:45:23.900437 --- ParallelTerminationStrategy: PID 14628 died... 23:45:23.920529 run iperf3-srv_10.42.42.10(pid=14628): Terminated {rc=256} 23:45:23.966747 --- ParallelTerminationStrategy: PID 14629 died... 23:45:23.986817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14629): Terminated: ok {rc=0} 23:45:24.033759 --- ParallelTerminationStrategy: PID 14630 died... 23:45:24.053916 run iperf3-srv_10.42.42.10(pid=14630): Terminated {rc=256} 23:45:24.100229 --- ParallelTerminationStrategy: PID 14631 died... 23:45:24.120432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14631): Terminated: ok {rc=0} 23:45:24.167191 --- ParallelTerminationStrategy: PID 14632 died... 23:45:24.187191 run iperf3-srv_10.42.42.10(pid=14632): Terminated {rc=256} 23:45:24.233354 --- ParallelTerminationStrategy: PID 14633 died... 23:45:24.253603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14633): Terminated: ok {rc=0} 23:45:24.300573 --- ParallelTerminationStrategy: PID 14634 died... 23:45:24.320593 run iperf3-srv_10.42.42.10(pid=14634): Terminated {rc=256} 23:45:24.366971 --- ParallelTerminationStrategy: PID 14637 died... 23:45:24.387037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14637): Terminated: ok {rc=0} 23:45:24.433669 --- ParallelTerminationStrategy: PID 14640 died... 23:45:24.453767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14640): Terminated: ok {rc=0} 23:45:24.500740 --- ParallelTerminationStrategy: PID 14643 died... 23:45:24.521037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14643): Terminated: ok {rc=0} 23:45:24.610517 bus /gobi_4: Setting Powered False 23:45:25.706837 bus /gobi_4: Setting Powered False 23:45:26.819406 bus /gobi_1: Setting Powered False 23:45:27.917828 bus /gobi_1: Setting Powered False 23:45:29.033749 bus /gobi_0: Setting Powered False 23:45:30.131786 bus /gobi_0: Setting Powered False 23:45:31.248845 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:45:32.352520 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:32.364149 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:45:32.434058 tst ping.py: using LAC 37059 23:45:32.551818 tst ping.py: using RAC 84 23:45:32.677173 tst ping.py: using CellId 37059 23:45:32.804267 tst ping.py: using BVCI 37060 23:45:32.920129 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:32.931793 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:32.943368 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:32.954899 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:32.967104 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:32.979347 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:32.992050 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:33.004331 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:33.121878 tst ping.py:19: start network... 23:45:33.317180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:33.767941 run create_hlr_db(pid=14645): Launched 23:45:33.887613 bus /gobi_6: Setting Powered False 23:45:34.945549 run create_hlr_db(pid=14645): Terminated: ok {rc=0} 23:45:35.373130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14647): Launched 23:45:35.683811 run osmo-hlr_10.42.42.2(pid=14648): Launched 23:45:35.803313 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:36.344072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14650): Launched 23:45:36.654312 run osmo-stp_10.42.42.5(pid=14651): Launched 23:45:36.773012 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:37.310410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14653): Launched 23:45:37.429080 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:37.692430 run patchelf(pid=14654): Launched 23:45:37.865717 run osmo-stp_10.42.42.5(pid=14651): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14651)] 23:45:37.998106 run osmo-stp_10.42.42.5(pid=14651): stdout: | (launched: 2022-12-13_23:45:36.597904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:38.132465 run osmo-stp_10.42.42.5(pid=14651): stderr: | [0;m[38;5;43m20221213234536787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234536787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234536788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234536788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234536789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234536789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234536789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:38.266878 run osmo-stp_10.42.42.5(pid=14651): stdout: | (launched: 2022-12-13_23:45:36.597904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:38.395688 run osmo-stp_10.42.42.5(pid=14651): stderr: | [0;m[38;5;43m20221213234536787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234536787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234536788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234536788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234536789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234536789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234536789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:38.547645 run patchelf(pid=14654): Terminating (SIGINT) 23:45:38.722926 run patchelf(pid=14654): Terminated: ok {rc=0} 23:45:38.849573 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14651): Process ended prematurely: osmo-stp_10.42.42.5(pid=14651) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14651)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 23:45:38.859150 tst ping.py:22: Test FAILED (6.5 sec) 23:45:38.886717 run osmo-hlr_10.42.42.2(pid=14648): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14648)] 23:45:38.937235 run osmo-hlr_10.42.42.2(pid=14648): stdout: | (launched: 2022-12-13_23:45:35.627744) 23:45:38.989469 run osmo-hlr_10.42.42.2(pid=14648): stderr: | [0;m[1;31m20221213234535823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234535823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234535823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234535823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234535823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234535823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234535835 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234535844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234535844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234535844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:39.041297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14647): Terminating (SIGTERM) 23:45:39.083149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14650): Terminating (SIGTERM) 23:45:39.125470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14653): Terminating (SIGTERM) 23:45:39.167884 --- ParallelTerminationStrategy: PID 14647 died... 23:45:39.188523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14647): Terminated: ok {rc=0} 23:45:39.235360 --- ParallelTerminationStrategy: PID 14650 died... 23:45:39.255674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14650): Terminated: ok {rc=0} 23:45:39.302238 --- ParallelTerminationStrategy: PID 14653 died... 23:45:39.322385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14653): Terminated: ok {rc=0} 23:45:39.410908 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:45:40.496743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:40.509064 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:45:40.582679 tst ping_idle_ping.py: using LAC 37060 23:45:40.706170 tst ping_idle_ping.py: using RAC 85 23:45:40.828699 tst ping_idle_ping.py: using CellId 37060 23:45:40.951330 tst ping_idle_ping.py: using BVCI 37061 23:45:41.065103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:41.076621 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:41.088037 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:41.099461 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:41.111134 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:41.122974 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:41.134822 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:41.146412 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:41.260627 tst ping_idle_ping.py:24: start network... 23:45:41.473178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:41.964387 run create_hlr_db(pid=14655): Launched 23:45:42.083682 bus /gobi_6: Setting Powered False 23:45:43.145394 run create_hlr_db(pid=14655): Terminated: ok {rc=0} 23:45:43.566112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14657): Launched 23:45:43.858562 run osmo-hlr_10.42.42.2(pid=14658): Launched 23:45:43.969469 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:44.487677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14660): Launched 23:45:44.779119 run osmo-stp_10.42.42.5(pid=14661): Launched 23:45:44.890681 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:45.396095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14663): Launched 23:45:45.507306 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:45.753592 run patchelf(pid=14664): Launched 23:45:45.942960 run osmo-stp_10.42.42.5(pid=14661): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14661)] 23:45:46.088350 run osmo-stp_10.42.42.5(pid=14661): stdout: | (launched: 2022-12-13_23:45:44.725955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:46.250382 run osmo-stp_10.42.42.5(pid=14661): stderr: | [0;m[38;5;43m20221213234544897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234544897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234544898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234544898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234544899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234544899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234544899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:46.412603 run osmo-stp_10.42.42.5(pid=14661): stdout: | (launched: 2022-12-13_23:45:44.725955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:46.566314 run osmo-stp_10.42.42.5(pid=14661): stderr: | [0;m[38;5;43m20221213234544897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234544897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234544898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234544898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234544899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234544899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234544899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:46.725787 run patchelf(pid=14664): Terminating (SIGINT) 23:45:46.908356 run patchelf(pid=14664): Terminated: ok {rc=0} 23:45:47.040614 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14661): Process ended prematurely: osmo-stp_10.42.42.5(pid=14661) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14661)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:45:47.051574 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:45:47.080741 run osmo-hlr_10.42.42.2(pid=14658): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14658)] 23:45:47.135166 run osmo-hlr_10.42.42.2(pid=14658): stdout: | (launched: 2022-12-13_23:45:43.805448) 23:45:47.189311 run osmo-hlr_10.42.42.2(pid=14658): stderr: | [0;m[1;31m20221213234543979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234543979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234543979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234543979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234543979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234543979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234543991 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234544001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234544001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234544001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:47.244682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14657): Terminating (SIGTERM) 23:45:47.288138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14660): Terminating (SIGTERM) 23:45:47.331094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14663): Terminating (SIGTERM) 23:45:47.373529 --- ParallelTerminationStrategy: PID 14657 died... 23:45:47.394046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14657): Terminated: ok {rc=0} 23:45:47.440808 --- ParallelTerminationStrategy: PID 14660 died... 23:45:47.461308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14660): Terminated: ok {rc=0} 23:45:47.507751 --- ParallelTerminationStrategy: PID 14663 died... 23:45:47.527771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14663): Terminated: ok {rc=0} 23:45:47.616522 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:45:48.926534 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:45:48.933096 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:45:48.967241 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:45:49.007736 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:45:49.097606 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:45:49.132585 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:45:49.172306 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:45:49.771147 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:45:49.821374 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:49.832338 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:45:49.900874 tst cs_paging_gprs_active.py: using LAC 37061 23:45:50.016559 tst cs_paging_gprs_active.py: using RAC 86 23:45:50.131840 tst cs_paging_gprs_active.py: using CellId 37061 23:45:50.258004 tst cs_paging_gprs_active.py: using BVCI 37062 23:45:50.375841 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:50.387288 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:50.398529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:50.410306 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:50.421813 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:50.433255 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:50.444840 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:50.456347 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:50.467990 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:45:50.585078 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:45:50.705757 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:45:50.921348 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:51.240657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14670): Launched 23:45:51.517362 run iperf3-srv_10.42.42.10(pid=14671): Launched 23:45:51.636922 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:45:51.852499 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:52.174022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14676): Launched 23:45:52.450485 run iperf3-srv_10.42.42.10(pid=14677): Launched 23:45:52.569768 tst cs_paging_gprs_active.py:38: start network... 23:45:52.785201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:53.279584 run create_hlr_db(pid=14678): Launched 23:45:53.400565 bus /gobi_6: Setting Powered False 23:45:54.464049 run create_hlr_db(pid=14678): Terminated: ok {rc=0} 23:45:54.890550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14680): Launched 23:45:55.189580 run osmo-hlr_10.42.42.2(pid=14681): Launched 23:45:55.303514 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:55.836800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14683): Launched 23:45:56.134024 run osmo-stp_10.42.42.5(pid=14684): Launched 23:45:56.247570 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:56.761033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14686): Launched 23:45:56.874866 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:57.126745 run patchelf(pid=14687): Launched 23:45:57.292275 run osmo-stp_10.42.42.5(pid=14684): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14684)] 23:45:57.418420 run osmo-stp_10.42.42.5(pid=14684): stdout: | (launched: 2022-12-13_23:45:56.080089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:57.546480 run osmo-stp_10.42.42.5(pid=14684): stderr: | [0;m[38;5;43m20221213234556249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234556249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234556249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234556249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234556251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234556252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234556252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:57.674622 run osmo-stp_10.42.42.5(pid=14684): stdout: | (launched: 2022-12-13_23:45:56.080089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:57.796692 run osmo-stp_10.42.42.5(pid=14684): stderr: | [0;m[38;5;43m20221213234556249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234556249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234556249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234556249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234556251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234556252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234556252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:57.941308 run patchelf(pid=14687): Terminating (SIGINT) 23:45:58.108738 run patchelf(pid=14687): Terminated: ok {rc=0} 23:45:58.229445 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14684): Process ended prematurely: osmo-stp_10.42.42.5(pid=14684) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14684)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:45:58.238808 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:45:58.265613 run osmo-hlr_10.42.42.2(pid=14681): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14681)] 23:45:58.312787 run osmo-hlr_10.42.42.2(pid=14681): stdout: | (launched: 2022-12-13_23:45:55.135480) 23:45:58.361924 run osmo-hlr_10.42.42.2(pid=14681): stderr: | [0;m[1;31m20221213234555311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234555311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234555311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234555311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234555312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234555312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234555324 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234555335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234555335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234555335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:58.411286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14670): Terminating (SIGTERM) 23:45:58.450501 run iperf3-srv_10.42.42.10(pid=14671): Terminating (SIGTERM) 23:45:58.489465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14676): Terminating (SIGTERM) 23:45:58.528542 run iperf3-srv_10.42.42.10(pid=14677): Terminating (SIGTERM) 23:45:58.567338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14680): Terminating (SIGTERM) 23:45:58.606369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14683): Terminating (SIGTERM) 23:45:58.645421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14686): Terminating (SIGTERM) 23:45:58.684591 --- ParallelTerminationStrategy: PID 14670 died... 23:45:58.703391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14670): Terminated: ok {rc=0} 23:45:58.746751 --- ParallelTerminationStrategy: PID 14671 died... 23:45:58.765035 run iperf3-srv_10.42.42.10(pid=14671): Terminated {rc=256} 23:45:58.807963 --- ParallelTerminationStrategy: PID 14676 died... 23:45:58.826408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14676): Terminated: ok {rc=0} 23:45:58.869461 --- ParallelTerminationStrategy: PID 14677 died... 23:45:58.887657 run iperf3-srv_10.42.42.10(pid=14677): Terminated {rc=256} 23:45:58.930882 --- ParallelTerminationStrategy: PID 14680 died... 23:45:58.949204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14680): Terminated: ok {rc=0} 23:45:58.993058 --- ParallelTerminationStrategy: PID 14683 died... 23:45:59.011414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14683): Terminated: ok {rc=0} 23:45:59.054535 --- ParallelTerminationStrategy: PID 14686 died... 23:45:59.072875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14686): Terminated: ok {rc=0} 23:45:59.157067 bus /gobi_0: Setting Powered False 23:46:00.255628 bus /gobi_0: Setting Powered False 23:46:01.368034 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:46:02.516548 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:02.528755 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:46:02.604058 tst iperf3.py: using LAC 37062 23:46:02.728321 tst iperf3.py: using RAC 87 23:46:02.860921 tst iperf3.py: using CellId 37062 23:46:02.996692 tst iperf3.py: using BVCI 37063 23:46:03.113898 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:03.125374 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:03.136614 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:03.147906 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:03.159454 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:03.171019 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:03.182680 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:03.194230 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:03.205930 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:03.320873 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:46:03.521027 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:46:03.819823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14688): Launched 23:46:04.079222 run iperf3-srv_10.42.42.10(pid=14689): Launched 23:46:04.191197 tst iperf3.py:8: start network... 23:46:04.391088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:04.852409 run create_hlr_db(pid=14690): Launched 23:46:04.979290 bus /gobi_6: Setting Powered False 23:46:06.042694 run create_hlr_db(pid=14690): Terminated: ok {rc=0} 23:46:06.485273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14692): Launched 23:46:06.804180 run osmo-hlr_10.42.42.2(pid=14693): Launched 23:46:06.925366 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:07.477586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14695): Launched 23:46:07.796568 run osmo-stp_10.42.42.5(pid=14696): Launched 23:46:07.918059 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:08.468072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14698): Launched 23:46:08.590143 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:08.859151 run patchelf(pid=14699): Launched 23:46:09.025406 run osmo-stp_10.42.42.5(pid=14696): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14696)] 23:46:09.152554 run osmo-stp_10.42.42.5(pid=14696): stdout: | (launched: 2022-12-13_23:46:07.738969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:09.281160 run osmo-stp_10.42.42.5(pid=14696): stderr: | [0;m[38;5;43m20221213234607933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234607933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234607934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234607934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234607934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234607934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234607934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:09.409502 run osmo-stp_10.42.42.5(pid=14696): stdout: | (launched: 2022-12-13_23:46:07.738969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:09.532300 run osmo-stp_10.42.42.5(pid=14696): stderr: | [0;m[38;5;43m20221213234607933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234607933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234607934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234607934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234607934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234607934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234607934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:09.677888 run patchelf(pid=14699): Terminating (SIGINT) 23:46:09.848136 run patchelf(pid=14699): Terminated: ok {rc=0} 23:46:09.968866 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14696): Process ended prematurely: osmo-stp_10.42.42.5(pid=14696) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14696)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 23:46:09.978227 tst iperf3.py:8: Test FAILED (7.5 sec) 23:46:10.004822 run osmo-hlr_10.42.42.2(pid=14693): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14693)] 23:46:10.052110 run osmo-hlr_10.42.42.2(pid=14693): stdout: | (launched: 2022-12-13_23:46:06.746241) 23:46:10.100800 run osmo-hlr_10.42.42.2(pid=14693): stderr: | [0;m[1;31m20221213234606946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234606946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234606946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234606946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234606946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234606946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234606959 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234606968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234606968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234606968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:10.150005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14688): Terminating (SIGTERM) 23:46:10.189141 run iperf3-srv_10.42.42.10(pid=14689): Terminating (SIGTERM) 23:46:10.228050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14692): Terminating (SIGTERM) 23:46:10.267246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14695): Terminating (SIGTERM) 23:46:10.306402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14698): Terminating (SIGTERM) 23:46:10.345870 --- ParallelTerminationStrategy: PID 14688 died... 23:46:10.364584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14688): Terminated: ok {rc=0} 23:46:10.408272 --- ParallelTerminationStrategy: PID 14689 died... 23:46:10.426552 run iperf3-srv_10.42.42.10(pid=14689): Terminated {rc=256} 23:46:10.469735 --- ParallelTerminationStrategy: PID 14692 died... 23:46:10.488061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14692): Terminated: ok {rc=0} 23:46:10.531223 --- ParallelTerminationStrategy: PID 14695 died... 23:46:10.549568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14695): Terminated: ok {rc=0} 23:46:10.592702 --- ParallelTerminationStrategy: PID 14698 died... 23:46:10.611079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14698): Terminated: ok {rc=0} 23:46:10.695525 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:46:11.841117 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:11.852660 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:46:11.924471 tst iperf3m4.py: using LAC 37063 23:46:12.050610 tst iperf3m4.py: using RAC 88 23:46:12.175469 tst iperf3m4.py: using CellId 37063 23:46:12.301464 tst iperf3m4.py: using BVCI 37064 23:46:12.411274 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:12.422323 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:12.433100 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:12.443917 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:12.454735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:12.465480 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:12.476286 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:12.487003 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:12.497961 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:12.614214 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:12.734489 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:12.851600 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:12.966646 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:46:13.167356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:46:13.466122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14700): Launched 23:46:13.724627 run iperf3-srv_10.42.42.10(pid=14701): Launched 23:46:13.836079 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:46:14.035614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:46:14.334251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14702): Launched 23:46:14.592421 run iperf3-srv_10.42.42.10(pid=14703): Launched 23:46:14.703824 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:46:14.903508 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:46:15.203482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14704): Launched 23:46:15.462078 run iperf3-srv_10.42.42.10(pid=14705): Launched 23:46:15.573414 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:46:15.772229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:46:16.128896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14706): Launched 23:46:16.421669 run iperf3-srv_10.42.42.10(pid=14707): Launched 23:46:16.551170 tst iperf3m4.py:8: start network... 23:46:16.773269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:17.277076 run create_hlr_db(pid=14708): Launched 23:46:17.399204 bus /gobi_6: Setting Powered False 23:46:18.461895 run create_hlr_db(pid=14708): Terminated: ok {rc=0} 23:46:18.887106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14710): Launched 23:46:19.184736 run osmo-hlr_10.42.42.2(pid=14711): Launched 23:46:19.297694 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:19.809039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14713): Launched 23:46:20.105247 run osmo-stp_10.42.42.5(pid=14714): Launched 23:46:20.217383 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:20.745685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14716): Launched 23:46:20.859069 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:21.110118 run patchelf(pid=14717): Launched 23:46:21.275649 run osmo-stp_10.42.42.5(pid=14714): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14714)] 23:46:21.401893 run osmo-stp_10.42.42.5(pid=14714): stdout: | (launched: 2022-12-13_23:46:20.050952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:21.529413 run osmo-stp_10.42.42.5(pid=14714): stderr: | [0;m[38;5;43m20221213234620222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234620222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234620223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234620223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234620223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234620223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234620224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:21.656925 run osmo-stp_10.42.42.5(pid=14714): stdout: | (launched: 2022-12-13_23:46:20.050952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:21.779139 run osmo-stp_10.42.42.5(pid=14714): stderr: | [0;m[38;5;43m20221213234620222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234620222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234620223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234620223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234620223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234620223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234620224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:21.923902 run patchelf(pid=14717): Terminating (SIGINT) 23:46:22.091339 run patchelf(pid=14717): Terminated: ok {rc=0} 23:46:22.211823 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14714): Process ended prematurely: osmo-stp_10.42.42.5(pid=14714) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14714)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:46:22.221383 tst iperf3m4.py:8: Test FAILED (10.4 sec) 23:46:22.248571 run osmo-hlr_10.42.42.2(pid=14711): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14711)] 23:46:22.296365 run osmo-hlr_10.42.42.2(pid=14711): stdout: | (launched: 2022-12-13_23:46:19.130047) 23:46:22.345624 run osmo-hlr_10.42.42.2(pid=14711): stderr: | [0;m[1;31m20221213234619305 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234619305 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234619305 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234619305 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234619305 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234619305 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234619321 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234619331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234619331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234619331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:22.394890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14700): Terminating (SIGTERM) 23:46:22.434539 run iperf3-srv_10.42.42.10(pid=14701): Terminating (SIGTERM) 23:46:22.473996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14702): Terminating (SIGTERM) 23:46:22.513512 run iperf3-srv_10.42.42.10(pid=14703): Terminating (SIGTERM) 23:46:22.553090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14704): Terminating (SIGTERM) 23:46:22.592318 run iperf3-srv_10.42.42.10(pid=14705): Terminating (SIGTERM) 23:46:22.631570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14706): Terminating (SIGTERM) 23:46:22.670991 run iperf3-srv_10.42.42.10(pid=14707): Terminating (SIGTERM) 23:46:22.710089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14710): Terminating (SIGTERM) 23:46:22.749414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14713): Terminating (SIGTERM) 23:46:22.788644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14716): Terminating (SIGTERM) 23:46:22.828205 --- ParallelTerminationStrategy: PID 14700 died... 23:46:22.847203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14700): Terminated: ok {rc=0} 23:46:22.890764 --- ParallelTerminationStrategy: PID 14701 died... 23:46:22.909167 run iperf3-srv_10.42.42.10(pid=14701): Terminated {rc=256} 23:46:22.952324 --- ParallelTerminationStrategy: PID 14702 died... 23:46:22.970769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14702): Terminated: ok {rc=0} 23:46:23.014111 --- ParallelTerminationStrategy: PID 14703 died... 23:46:23.032474 run iperf3-srv_10.42.42.10(pid=14703): Terminated {rc=256} 23:46:23.075882 --- ParallelTerminationStrategy: PID 14704 died... 23:46:23.094323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14704): Terminated: ok {rc=0} 23:46:23.137714 --- ParallelTerminationStrategy: PID 14705 died... 23:46:23.156524 run iperf3-srv_10.42.42.10(pid=14705): Terminated {rc=256} 23:46:23.200133 --- ParallelTerminationStrategy: PID 14706 died... 23:46:23.218577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14706): Terminated: ok {rc=0} 23:46:23.262053 --- ParallelTerminationStrategy: PID 14707 died... 23:46:23.280402 run iperf3-srv_10.42.42.10(pid=14707): Terminated {rc=256} 23:46:23.323800 --- ParallelTerminationStrategy: PID 14710 died... 23:46:23.342298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14710): Terminated: ok {rc=0} 23:46:23.385593 --- ParallelTerminationStrategy: PID 14713 died... 23:46:23.404040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14713): Terminated: ok {rc=0} 23:46:23.447481 --- ParallelTerminationStrategy: PID 14716 died... 23:46:23.466018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14716): Terminated: ok {rc=0} 23:46:23.551215 bus /gobi_4: Setting Powered False 23:46:24.652575 bus /gobi_4: Setting Powered False 23:46:25.770707 bus /gobi_1: Setting Powered False 23:46:26.869101 bus /gobi_1: Setting Powered False 23:46:27.981090 bus /gobi_0: Setting Powered False 23:46:29.077123 bus /gobi_0: Setting Powered False 23:46:30.194133 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:46:31.303647 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:31.319424 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:46:31.407993 tst ping.py: using LAC 37064 23:46:31.552730 tst ping.py: using RAC 89 23:46:31.694373 tst ping.py: using CellId 37064 23:46:31.813045 tst ping.py: using BVCI 37065 23:46:31.923337 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:31.934927 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:31.946247 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:31.957515 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:31.968435 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:31.979780 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:31.991570 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:32.003198 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:32.141823 tst ping.py:19: start network... 23:46:32.360368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:32.811776 run create_hlr_db(pid=14718): Launched 23:46:32.930638 bus /gobi_6: Setting Powered False 23:46:33.989265 run create_hlr_db(pid=14718): Terminated: ok {rc=0} 23:46:34.417162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14721): Launched 23:46:34.729202 run osmo-hlr_10.42.42.2(pid=14722): Launched 23:46:34.848864 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:35.397653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14724): Launched 23:46:35.709118 run osmo-stp_10.42.42.5(pid=14725): Launched 23:46:35.828113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:36.367039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14727): Launched 23:46:36.487061 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:36.750793 run patchelf(pid=14728): Launched 23:46:36.924737 run osmo-stp_10.42.42.5(pid=14725): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14725)] 23:46:37.057639 run osmo-stp_10.42.42.5(pid=14725): stdout: | (launched: 2022-12-13_23:46:35.652799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:37.192412 run osmo-stp_10.42.42.5(pid=14725): stderr: | [0;m[38;5;43m20221213234635842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234635842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234635842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234635843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234635843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234635843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234635843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:37.327591 run osmo-stp_10.42.42.5(pid=14725): stdout: | (launched: 2022-12-13_23:46:35.652799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:37.456455 run osmo-stp_10.42.42.5(pid=14725): stderr: | [0;m[38;5;43m20221213234635842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234635842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234635842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234635843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234635843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234635843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234635843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:37.609533 run patchelf(pid=14728): Terminating (SIGINT) 23:46:37.784113 run patchelf(pid=14728): Terminated: ok {rc=0} 23:46:37.910763 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14725): Process ended prematurely: osmo-stp_10.42.42.5(pid=14725) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14725)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 23:46:37.920413 tst ping.py:22: Test FAILED (6.6 sec) 23:46:37.948444 run osmo-hlr_10.42.42.2(pid=14722): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14722)] 23:46:37.998769 run osmo-hlr_10.42.42.2(pid=14722): stdout: | (launched: 2022-12-13_23:46:34.672642) 23:46:38.051089 run osmo-hlr_10.42.42.2(pid=14722): stderr: | [0;m[1;31m20221213234634871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234634871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234634871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234634871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234634871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234634871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234634885 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234634893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234634894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234634894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:38.102928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14721): Terminating (SIGTERM) 23:46:38.144737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14724): Terminating (SIGTERM) 23:46:38.186936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14727): Terminating (SIGTERM) 23:46:38.228823 --- ParallelTerminationStrategy: PID 14721 died... 23:46:38.249068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14721): Terminated: ok {rc=0} 23:46:38.295413 --- ParallelTerminationStrategy: PID 14724 died... 23:46:38.315167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14724): Terminated: ok {rc=0} 23:46:38.360827 --- ParallelTerminationStrategy: PID 14727 died... 23:46:38.380798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14727): Terminated: ok {rc=0} 23:46:38.467787 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:46:39.554664 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:39.566634 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:46:39.640058 tst ping_idle_ping.py: using LAC 37065 23:46:39.767556 tst ping_idle_ping.py: using RAC 90 23:46:39.888923 tst ping_idle_ping.py: using CellId 37065 23:46:40.010064 tst ping_idle_ping.py: using BVCI 37066 23:46:40.125051 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:40.136399 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:40.147742 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:40.159124 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:40.170611 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:40.182115 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:40.193804 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:40.205454 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:40.322554 tst ping_idle_ping.py:24: start network... 23:46:40.534676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:41.021864 run create_hlr_db(pid=14729): Launched 23:46:41.141391 bus /gobi_6: Setting Powered False 23:46:42.204047 run create_hlr_db(pid=14729): Terminated: ok {rc=0} 23:46:42.641991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14731): Launched 23:46:42.954085 run osmo-hlr_10.42.42.2(pid=14732): Launched 23:46:43.073883 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:43.615300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14734): Launched 23:46:43.926935 run osmo-stp_10.42.42.5(pid=14735): Launched 23:46:44.046706 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:44.587089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14737): Launched 23:46:44.706757 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:44.971030 run patchelf(pid=14738): Launched 23:46:45.144617 run osmo-stp_10.42.42.5(pid=14735): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14735)] 23:46:45.277557 run osmo-stp_10.42.42.5(pid=14735): stdout: | (launched: 2022-12-13_23:46:43.870369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:45.413142 run osmo-stp_10.42.42.5(pid=14735): stderr: | [0;m[38;5;43m20221213234644059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234644059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234644060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234644060 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234644061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234644061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234644061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:45.547742 run osmo-stp_10.42.42.5(pid=14735): stdout: | (launched: 2022-12-13_23:46:43.870369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:45.676465 run osmo-stp_10.42.42.5(pid=14735): stderr: | [0;m[38;5;43m20221213234644059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234644059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234644060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234644060 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234644061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234644061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234644061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:45.830148 run patchelf(pid=14738): Terminating (SIGINT) 23:46:46.019336 run patchelf(pid=14738): Terminated: ok {rc=0} 23:46:46.148779 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14735): Process ended prematurely: osmo-stp_10.42.42.5(pid=14735) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14735)] [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:46:46.159198 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:46:46.188121 run osmo-hlr_10.42.42.2(pid=14732): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14732)] 23:46:46.240384 run osmo-hlr_10.42.42.2(pid=14732): stdout: | (launched: 2022-12-13_23:46:42.897601) 23:46:46.294679 run osmo-hlr_10.42.42.2(pid=14732): stderr: | [0;m[1;31m20221213234643094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234643094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234643094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234643094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234643094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234643095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234643107 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234643115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234643116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234643116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:46.348764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14731): Terminating (SIGTERM) 23:46:46.391533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14734): Terminating (SIGTERM) 23:46:46.435279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14737): Terminating (SIGTERM) 23:46:46.480161 --- ParallelTerminationStrategy: PID 14731 died... 23:46:46.501311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14731): Terminated: ok {rc=0} 23:46:46.548686 --- ParallelTerminationStrategy: PID 14734 died... 23:46:46.569682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14734): Terminated: ok {rc=0} 23:46:46.616810 --- ParallelTerminationStrategy: PID 14737 died... 23:46:46.637741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14737): Terminated: ok {rc=0} 23:46:46.727185 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:46:48.042442 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:46:48.049506 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:46:48.082544 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:46:48.118059 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:46:48.171499 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:46:48.204522 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:46:48.238620 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:46:48.797878 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:46:48.803976 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:48.816001 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:46:48.885912 tst switch_tch_pdch.py: using LAC 37066 23:46:49.001766 tst switch_tch_pdch.py: using RAC 91 23:46:49.118939 tst switch_tch_pdch.py: using CellId 37066 23:46:49.235404 tst switch_tch_pdch.py: using BVCI 37067 23:46:49.340937 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:49.352423 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:49.363816 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:49.374993 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:49.386136 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:49.397193 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:49.408169 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:49.419202 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:46:49.538928 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:46:49.654831 tst switch_tch_pdch.py:51: start network... 23:46:49.851735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:50.305091 run create_hlr_db(pid=14742): Launched 23:46:50.425616 bus /gobi_6: Setting Powered False 23:46:51.484414 run create_hlr_db(pid=14742): Terminated: ok {rc=0} 23:46:51.914326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14744): Launched 23:46:52.226151 run osmo-hlr_10.42.42.2(pid=14745): Launched 23:46:52.345583 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:52.884096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14747): Launched 23:46:53.193922 run osmo-stp_10.42.42.5(pid=14748): Launched 23:46:53.313262 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:53.849341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14750): Launched 23:46:53.968202 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:54.230973 run patchelf(pid=14751): Launched 23:46:54.404383 run osmo-stp_10.42.42.5(pid=14748): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14748)] 23:46:54.536524 run osmo-stp_10.42.42.5(pid=14748): stdout: | (launched: 2022-12-13_23:46:53.137757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:54.670217 run osmo-stp_10.42.42.5(pid=14748): stderr: | [0;m[38;5;43m20221213234653328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234653328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234653328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234653329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234653329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234653329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234653329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:54.803844 run osmo-stp_10.42.42.5(pid=14748): stdout: | (launched: 2022-12-13_23:46:53.137757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:54.931744 run osmo-stp_10.42.42.5(pid=14748): stderr: | [0;m[38;5;43m20221213234653328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234653328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234653328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234653329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234653329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234653329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234653329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:55.083287 run patchelf(pid=14751): Terminating (SIGINT) 23:46:55.257744 run patchelf(pid=14751): Terminated: ok {rc=0} 23:46:55.384402 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14748): Process ended prematurely: osmo-stp_10.42.42.5(pid=14748) [trial-2396↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14748)] [trial-2396↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:46:55.393981 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 23:46:55.421507 run osmo-hlr_10.42.42.2(pid=14745): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14745)] 23:46:55.472090 run osmo-hlr_10.42.42.2(pid=14745): stdout: | (launched: 2022-12-13_23:46:52.169813) 23:46:55.523755 run osmo-hlr_10.42.42.2(pid=14745): stderr: | [0;m[1;31m20221213234652363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234652364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234652364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234652364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234652364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234652364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234652376 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234652384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234652385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234652385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:55.575790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14744): Terminating (SIGTERM) 23:46:55.617264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14747): Terminating (SIGTERM) 23:46:55.658676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14750): Terminating (SIGTERM) 23:46:55.700082 --- ParallelTerminationStrategy: PID 14744 died... 23:46:55.719757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14744): Terminated: ok {rc=0} 23:46:55.765493 --- ParallelTerminationStrategy: PID 14747 died... 23:46:55.784919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14747): Terminated: ok {rc=0} 23:46:55.830774 --- ParallelTerminationStrategy: PID 14750 died... 23:46:55.850351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14750): Terminated: ok {rc=0} 23:46:55.938568 bus /gobi_0: Setting Powered False 23:46:57.034645 bus /gobi_0: Setting Powered False 23:46:58.149316 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:46:59.406636 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:46:59.414110 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:46:59.448663 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:46:59.485141 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:46:59.538484 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:46:59.572667 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:46:59.606709 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:47:00.162779 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:47:00.167692 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:00.178675 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:47:00.246801 tst switch_tch_pdch.py: using LAC 37067 23:47:00.362209 tst switch_tch_pdch.py: using RAC 92 23:47:00.474699 tst switch_tch_pdch.py: using CellId 37067 23:47:00.587435 tst switch_tch_pdch.py: using BVCI 37068 23:47:00.693100 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:00.704009 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:00.714760 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:00.725478 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:00.736255 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:00.746998 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:00.757856 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:00.769065 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:47:00.890661 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:47:01.039864 tst switch_tch_pdch.py:51: start network... 23:47:01.321967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:01.771172 run create_hlr_db(pid=14755): Launched 23:47:01.930408 bus /gobi_6: Setting Powered False 23:47:02.989466 run create_hlr_db(pid=14755): Terminated: ok {rc=0} 23:47:03.392308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14757): Launched 23:47:03.704519 run osmo-hlr_10.42.42.2(pid=14758): Launched 23:47:03.823712 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:04.336547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14760): Launched 23:47:04.647755 run osmo-stp_10.42.42.5(pid=14761): Launched 23:47:04.767146 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:47:05.277980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14763): Launched 23:47:05.397490 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:47:05.659731 run patchelf(pid=14764): Launched 23:47:05.832597 run osmo-stp_10.42.42.5(pid=14761): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14761)] 23:47:05.964690 run osmo-stp_10.42.42.5(pid=14761): stdout: | (launched: 2022-12-13_23:47:04.591343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:06.098617 run osmo-stp_10.42.42.5(pid=14761): stderr: | [0;m[38;5;43m20221213234704780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234704781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234704781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234704781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234704782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234704782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234704782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:06.232014 run osmo-stp_10.42.42.5(pid=14761): stdout: | (launched: 2022-12-13_23:47:04.591343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:06.360804 run osmo-stp_10.42.42.5(pid=14761): stderr: | [0;m[38;5;43m20221213234704780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234704781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234704781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234704781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234704782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234704782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234704782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:06.512560 run patchelf(pid=14764): Terminating (SIGINT) 23:47:06.687159 run patchelf(pid=14764): Terminated: ok {rc=0} 23:47:06.812831 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14761): Process ended prematurely: osmo-stp_10.42.42.5(pid=14761) [trial-2396↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14761)] [trial-2396↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:47:06.822357 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 23:47:06.850026 run osmo-hlr_10.42.42.2(pid=14758): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14758)] 23:47:06.900844 run osmo-hlr_10.42.42.2(pid=14758): stdout: | (launched: 2022-12-13_23:47:03.647997) 23:47:06.952720 run osmo-hlr_10.42.42.2(pid=14758): stderr: | [0;m[1;31m20221213234703844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234703845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234703845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234703845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234703845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234703845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234703862 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234703871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234703871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234703872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:07.004850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14757): Terminating (SIGTERM) 23:47:07.046479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14760): Terminating (SIGTERM) 23:47:07.088076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14763): Terminating (SIGTERM) 23:47:07.129898 --- ParallelTerminationStrategy: PID 14757 died... 23:47:07.150146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14757): Terminated: ok {rc=0} 23:47:07.196166 --- ParallelTerminationStrategy: PID 14760 died... 23:47:07.215638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14760): Terminated: ok {rc=0} 23:47:07.261301 --- ParallelTerminationStrategy: PID 14763 died... 23:47:07.280850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14763): Terminated: ok {rc=0} 23:47:07.368356 bus /gobi_0: Setting Powered False 23:47:08.466344 bus /gobi_0: Setting Powered False 23:47:09.581189 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_sms:trx-umtrx --------------------------------------------------------------------- 23:47:10.843918 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:10.847974 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:47:10.880544 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 23:47:10.888597 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 23:47:10.941196 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:47:10.973071 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 23:47:10.979793 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 23:47:11.521071 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 23:47:11.526413 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 23:47:11.537549 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 23:47:11.586092 tst mo_mt_sms.py: using LAC 37068 23:47:11.709140 tst mo_mt_sms.py: using RAC 93 23:47:11.829652 tst mo_mt_sms.py: using CellId 37068 23:47:11.945325 tst mo_mt_sms.py: using BVCI 37069 23:47:12.051211 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 23:47:12.169499 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 23:47:12.285478 tst mo_mt_sms.py:9: start nitb and bts... 23:47:12.498273 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:47:13.134239 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14768): Launched 23:47:13.445803 run osmo-nitb_10.42.42.2(pid=14769): Launched 23:47:13.618731 run osmo-nitb_10.42.42.2(pid=14769): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14769)] 23:47:13.759079 run osmo-nitb_10.42.42.2(pid=14769): stdout: | (launched: 2022-12-13_23:47:13.389440) 23:47:13.900683 run osmo-nitb_10.42.42.2(pid=14769): stderr: | (launched: 2022-12-13_23:47:13.435886) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:47:14.042450 run osmo-nitb_10.42.42.2(pid=14769): stdout: | (launched: 2022-12-13_23:47:13.389440) 23:47:14.178973 run osmo-nitb_10.42.42.2(pid=14769): stderr: | (launched: 2022-12-13_23:47:13.435886) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14769): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14769) [trial-2396↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14769)] 23:47:14.563231 tst osmo-nitb_10.42.42.2(pid=14769): stdout: | (launched: 2022-12-13_23:47:13.389440) 23:47:14.690152 tst osmo-nitb_10.42.42.2(pid=14769): stderr: | (launched: 2022-12-13_23:47:13.435886) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:47:14.839029 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=14769): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14769) [trial-2396↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14769)] [trial-2396↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 23:47:14.847948 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 23:47:14.854824 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14768): Terminating (SIGTERM) 23:47:15.066358 --- ParallelTerminationStrategy: PID 14768 died... 23:47:15.088073 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14768): Terminated: ok {rc=0} 23:47:15.176093 bus /sierra_3: Setting Powered False 23:47:16.274518 bus /sierra_3: Setting Powered False 23:47:17.391566 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 sms:trx-umtrx --------------------------------------------------------------------- 23:47:18.591018 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:18.595684 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:47:18.627609 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:47:18.654093 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 23:47:18.705252 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:47:18.737725 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:47:18.764401 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 23:47:19.309510 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 23:47:19.314236 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:19.324639 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 23:47:19.371486 tst mo_mt_sms.py: using LAC 37069 23:47:19.496896 tst mo_mt_sms.py: using RAC 94 23:47:19.613093 tst mo_mt_sms.py: using CellId 37069 23:47:19.729180 tst mo_mt_sms.py: using BVCI 37070 23:47:19.834956 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:19.845721 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:19.856232 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:19.866652 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:19.876823 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:19.887122 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 23:47:20.002944 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 23:47:20.118357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:20.601908 run create_hlr_db(pid=14773): Launched 23:47:20.720096 bus /sierra_2: Setting Powered False 23:47:21.781835 run create_hlr_db(pid=14773): Terminated: ok {rc=0} 23:47:22.201108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14775): Launched 23:47:22.491810 run osmo-hlr_10.42.42.2(pid=14776): Launched 23:47:22.603563 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:23.106951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14778): Launched 23:47:23.398443 run osmo-stp_10.42.42.5(pid=14779): Launched 23:47:23.509930 run osmo-msc_10.42.42.6: Starting osmo-msc 23:47:24.038995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14781): Launched 23:47:24.329855 run osmo-msc_10.42.42.6(pid=14782): Launched 23:47:24.492318 run osmo-stp_10.42.42.5(pid=14779): ERR: Terminated: ERROR {rc=1} [trial-2396↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14779)] 23:47:24.616873 run osmo-stp_10.42.42.5(pid=14779): stdout: | (launched: 2022-12-13_23:47:23.345456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:24.740802 run osmo-stp_10.42.42.5(pid=14779): stderr: | [0;m[38;5;43m20221213234723514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234723514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234723514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234723514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234723515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234723515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234723515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:24.862657 run osmo-stp_10.42.42.5(pid=14779): stdout: | (launched: 2022-12-13_23:47:23.345456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:24.978698 run osmo-stp_10.42.42.5(pid=14779): stderr: | [0;m[38;5;43m20221213234723514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234723514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234723514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234723514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234723515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234723515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234723515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:25.118040 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14779): Process ended prematurely: osmo-stp_10.42.42.5(pid=14779) [trial-2396↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14779)] [trial-2396↪sms:trx-umtrx↪mo_mt_sms.py:16] 23:47:25.126287 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 23:47:25.151918 run osmo-hlr_10.42.42.2(pid=14776): ERR: Terminated: ERROR {rc=237} [trial-2396↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14776)] 23:47:25.199053 run osmo-hlr_10.42.42.2(pid=14776): stdout: | (launched: 2022-12-13_23:47:22.438568) 23:47:25.248384 run osmo-hlr_10.42.42.2(pid=14776): stderr: | [0;m[1;31m20221213234722615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234722615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234722615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234722615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234722616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234722616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234722629 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234722639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234722639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234722639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:25.317046 run osmo-msc_10.42.42.6(pid=14782): ERR: Terminated: ERROR {rc=2} [trial-2396↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14782)] 23:47:25.365040 run osmo-msc_10.42.42.6(pid=14782): stdout: | (launched: 2022-12-13_23:47:24.276488) 23:47:25.414029 run osmo-msc_10.42.42.6(pid=14782): stderr: | [0;m[38;5;43m20221213234724544 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234724544 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4f5cee9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234724544 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234724544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234724545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234724545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234724547 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234724547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234724547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234724547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:47:25.463713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14775): Terminating (SIGTERM) 23:47:25.502942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14778): Terminating (SIGTERM) 23:47:25.542404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14781): Terminating (SIGTERM) 23:47:25.582248 --- ParallelTerminationStrategy: PID 14775 died... 23:47:25.601272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14775): Terminated: ok {rc=0} 23:47:25.645120 --- ParallelTerminationStrategy: PID 14778 died... 23:47:25.663835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14778): Terminated: ok {rc=0} 23:47:25.707242 --- ParallelTerminationStrategy: PID 14781 died... 23:47:25.725721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14781): Terminated: ok {rc=0} 23:47:25.808245 bus /sierra_3: Setting Powered False 23:47:26.905396 bus /sierra_3: Setting Powered False 23:47:28.023187 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 23:47:29.252551 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:29.257552 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:47:29.290653 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 23:47:29.298525 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 23:47:29.334784 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:47:29.368582 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 23:47:29.375595 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 23:47:29.894067 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2396 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 23:47:29.899406 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 23:47:29.910650 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 23:47:29.959631 tst assert_extension.py: using LAC 37070 23:47:30.082311 tst assert_extension.py: using RAC 95 23:47:30.204493 tst assert_extension.py: using CellId 37070 23:47:30.320172 tst assert_extension.py: using BVCI 37071 23:47:30.434957 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 23:47:30.547893 tst assert_extension.py:10: start nitb and bts... 23:47:30.744177 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:47:31.383506 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14787): Launched 23:47:31.694791 run osmo-nitb_10.42.42.2(pid=14788): Launched 23:47:31.889193 run osmo-nitb_10.42.42.2(pid=14788): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14788)] 23:47:32.022453 run osmo-nitb_10.42.42.2(pid=14788): stdout: | (launched: 2022-12-13_23:47:31.633783) 23:47:32.158472 run osmo-nitb_10.42.42.2(pid=14788): stderr: | (launched: 2022-12-13_23:47:31.678281) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:47:32.292273 run osmo-nitb_10.42.42.2(pid=14788): stdout: | (launched: 2022-12-13_23:47:31.633783) 23:47:32.419674 run osmo-nitb_10.42.42.2(pid=14788): stderr: | (launched: 2022-12-13_23:47:31.678281) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14788): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14788) [trial-2396↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14788)] 23:47:32.835928 tst osmo-nitb_10.42.42.2(pid=14788): stdout: | (launched: 2022-12-13_23:47:31.633783) 23:47:32.954214 tst osmo-nitb_10.42.42.2(pid=14788): stderr: | (launched: 2022-12-13_23:47:31.678281) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:47:33.092857 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14788): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14788) [trial-2396↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14788)] [trial-2396↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 23:47:33.101286 tst assert_extension.py:12: Test FAILED (3.2 sec) 23:47:33.107675 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14787): Terminating (SIGTERM) 23:47:33.315707 --- ParallelTerminationStrategy: PID 14787 died... 23:47:33.336154 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14787): Terminated: ok {rc=0} 23:47:33.418774 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 ussd:trx-umtrx --------------------------------------------------------------------- 23:47:34.589161 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:34.592882 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:47:34.624607 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:47:34.650869 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 23:47:34.685431 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:47:34.717298 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:47:34.743629 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 23:47:35.272583 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2396 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 23:47:35.277705 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:35.288212 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 23:47:35.334906 tst assert_extension.py: using LAC 37071 23:47:35.460690 tst assert_extension.py: using RAC 96 23:47:35.583638 tst assert_extension.py: using CellId 37071 23:47:35.705386 tst assert_extension.py: using BVCI 37072 23:47:35.818985 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:35.830128 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:35.841312 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:35.852196 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:35.863553 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:35.874942 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 23:47:35.988621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:36.438656 run create_hlr_db(pid=14792): Launched 23:47:36.559126 bus /sierra_2: Setting Powered False 23:47:37.618099 run create_hlr_db(pid=14792): Terminated: ok {rc=0} 23:47:38.027628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14794): Launched 23:47:38.318962 run osmo-hlr_10.42.42.2(pid=14795): Launched 23:47:38.429924 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:38.935588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14797): Launched 23:47:39.227055 run osmo-stp_10.42.42.5(pid=14798): Launched 23:47:39.337786 run osmo-msc_10.42.42.6: Starting osmo-msc 23:47:39.866350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14800): Launched 23:47:40.157569 run osmo-msc_10.42.42.6(pid=14801): Launched 23:47:40.319809 run osmo-stp_10.42.42.5(pid=14798): ERR: Terminated: ERROR {rc=1} [trial-2396↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14798)] 23:47:40.444294 run osmo-stp_10.42.42.5(pid=14798): stdout: | (launched: 2022-12-13_23:47:39.173918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:40.569345 run osmo-stp_10.42.42.5(pid=14798): stderr: | [0;m[38;5;43m20221213234739344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234739344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234739345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234739345 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234739345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234739346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234739346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:40.691581 run osmo-stp_10.42.42.5(pid=14798): stdout: | (launched: 2022-12-13_23:47:39.173918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:40.808569 run osmo-stp_10.42.42.5(pid=14798): stderr: | [0;m[38;5;43m20221213234739344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234739344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234739345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234739345 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234739345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234739346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234739346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:40.948170 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14798): Process ended prematurely: osmo-stp_10.42.42.5(pid=14798) [trial-2396↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14798)] [trial-2396↪ussd:trx-umtrx↪assert_extension.py:17] 23:47:40.956293 tst assert_extension.py:17: Test FAILED (5.7 sec) 23:47:40.981760 run osmo-hlr_10.42.42.2(pid=14795): ERR: Terminated: ERROR {rc=237} [trial-2396↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14795)] 23:47:41.028757 run osmo-hlr_10.42.42.2(pid=14795): stdout: | (launched: 2022-12-13_23:47:38.265860) 23:47:41.077539 run osmo-hlr_10.42.42.2(pid=14795): stderr: | [0;m[1;31m20221213234738439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234738439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234738439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234738439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234738439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234738439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234738452 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234738460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234738460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234738460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:41.145532 run osmo-msc_10.42.42.6(pid=14801): ERR: Terminated: ERROR {rc=2} [trial-2396↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14801)] 23:47:41.192353 run osmo-msc_10.42.42.6(pid=14801): stdout: | (launched: 2022-12-13_23:47:40.104139) 23:47:41.241031 run osmo-msc_10.42.42.6(pid=14801): stderr: | [0;m[38;5;43m20221213234740373 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234740373 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f464d539c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234740373 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234740373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234740373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234740374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234740375 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234740376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234740376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234740376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:47:41.290037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14794): Terminating (SIGTERM) 23:47:41.329211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14797): Terminating (SIGTERM) 23:47:41.368579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14800): Terminating (SIGTERM) 23:47:41.408336 --- ParallelTerminationStrategy: PID 14794 died... 23:47:41.427296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14794): Terminated: ok {rc=0} 23:47:41.470593 --- ParallelTerminationStrategy: PID 14797 died... 23:47:41.488850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14797): Terminated: ok {rc=0} 23:47:41.531944 --- ParallelTerminationStrategy: PID 14800 died... 23:47:41.550311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14800): Terminated: ok {rc=0} 23:47:41.635043 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:47:42.842715 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:42.849354 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:47:42.881152 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:47:42.908694 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:47:42.961210 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:47:42.993174 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:47:43.020080 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:47:43.573389 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:47:43.622877 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:43.634079 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:47:43.700756 tst mo_mt_call.py: using LAC 37072 23:47:43.816518 tst mo_mt_call.py: using RAC 97 23:47:43.932531 tst mo_mt_call.py: using CellId 37072 23:47:44.047502 tst mo_mt_call.py: using BVCI 37073 23:47:44.155668 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:44.166683 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:44.177557 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:44.188366 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:44.199443 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:44.210461 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:47:44.330066 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:47:44.445569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:44.907687 run create_hlr_db(pid=14806): Launched 23:47:45.029628 bus /sierra_2: Setting Powered False 23:47:46.102918 run create_hlr_db(pid=14806): Terminated: ok {rc=0} 23:47:46.627053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14808): Launched 23:47:46.944234 run osmo-hlr_10.42.42.2(pid=14809): Launched 23:47:47.126340 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:47.711990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14811): Launched 23:47:48.030030 run osmo-stp_10.42.42.5(pid=14812): Launched 23:47:48.151330 run osmo-msc_10.42.42.6: Starting osmo-msc 23:47:48.728829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14814): Launched 23:47:49.047139 run osmo-msc_10.42.42.6(pid=14815): Launched 23:47:49.224902 run osmo-stp_10.42.42.5(pid=14812): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14812)] 23:47:49.360001 run osmo-stp_10.42.42.5(pid=14812): stdout: | (launched: 2022-12-13_23:47:47.972588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:49.495624 run osmo-stp_10.42.42.5(pid=14812): stderr: | [0;m[38;5;43m20221213234748163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234748163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234748163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234748163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234748166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234748166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234748166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:49.630054 run osmo-stp_10.42.42.5(pid=14812): stdout: | (launched: 2022-12-13_23:47:47.972588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:49.756863 run osmo-stp_10.42.42.5(pid=14812): stderr: | [0;m[38;5;43m20221213234748163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234748163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234748163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234748163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234748166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234748166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234748166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:49.908616 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14812): Process ended prematurely: osmo-stp_10.42.42.5(pid=14812) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14812)] [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:47:49.918259 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:47:49.945590 run osmo-hlr_10.42.42.2(pid=14809): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14809)] 23:47:49.995537 run osmo-hlr_10.42.42.2(pid=14809): stdout: | (launched: 2022-12-13_23:47:46.881722) 23:47:50.047377 run osmo-hlr_10.42.42.2(pid=14809): stderr: | [0;m[1;31m20221213234747189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234747189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234747190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234747190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234747190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234747190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234747206 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234747227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234747227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234747227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:50.119045 run osmo-msc_10.42.42.6(pid=14815): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14815)] 23:47:50.168352 run osmo-msc_10.42.42.6(pid=14815): stdout: | (launched: 2022-12-13_23:47:48.989616) 23:47:50.219573 run osmo-msc_10.42.42.6(pid=14815): stderr: | [0;m[38;5;43m20221213234749311 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234749312 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc725ebcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234749312 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234749312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234749312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234749312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234749314 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234749314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234749314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234749315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:47:50.270958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14808): Terminating (SIGTERM) 23:47:50.312213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14811): Terminating (SIGTERM) 23:47:50.354042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14814): Terminating (SIGTERM) 23:47:50.395631 --- ParallelTerminationStrategy: PID 14808 died... 23:47:50.415678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14808): Terminated: ok {rc=0} 23:47:50.461408 --- ParallelTerminationStrategy: PID 14811 died... 23:47:50.480901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14811): Terminated: ok {rc=0} 23:47:50.526566 --- ParallelTerminationStrategy: PID 14814 died... 23:47:50.546018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14814): Terminated: ok {rc=0} 23:47:50.632436 bus /sierra_3: Setting Powered False 23:47:51.730185 bus /sierra_3: Setting Powered False 23:47:52.843684 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:47:53.990976 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:54.003217 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:47:54.074816 tst mo_mt_call_osmux.py: using LAC 37073 23:47:54.191537 tst mo_mt_call_osmux.py: using RAC 98 23:47:54.310321 tst mo_mt_call_osmux.py: using CellId 37073 23:47:54.429307 tst mo_mt_call_osmux.py: using BVCI 37074 23:47:54.538310 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:54.549339 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:54.560161 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:54.570984 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:54.581966 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:54.593286 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:47:54.710285 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:47:54.830727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:55.323087 run create_hlr_db(pid=14817): Launched 23:47:55.445798 bus /sierra_2: Setting Powered False 23:47:56.508714 run create_hlr_db(pid=14817): Terminated: ok {rc=0} 23:47:56.950989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14819): Launched 23:47:57.269181 run osmo-hlr_10.42.42.2(pid=14820): Launched 23:47:57.391954 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:57.939224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14822): Launched 23:47:58.256757 run osmo-stp_10.42.42.5(pid=14823): Launched 23:47:58.379787 run osmo-msc_10.42.42.6: Starting osmo-msc 23:47:58.954576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14825): Launched 23:47:59.272861 run osmo-msc_10.42.42.6(pid=14826): Launched 23:47:59.451789 run osmo-stp_10.42.42.5(pid=14823): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14823)] 23:47:59.586526 run osmo-stp_10.42.42.5(pid=14823): stdout: | (launched: 2022-12-13_23:47:58.199293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:59.721913 run osmo-stp_10.42.42.5(pid=14823): stderr: | [0;m[38;5;43m20221213234758392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234758392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234758392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234758393 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234758393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234758393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234758393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:59.856579 run osmo-stp_10.42.42.5(pid=14823): stdout: | (launched: 2022-12-13_23:47:58.199293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:59.983600 run osmo-stp_10.42.42.5(pid=14823): stderr: | [0;m[38;5;43m20221213234758392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234758392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234758392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234758393 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234758393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234758393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234758393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:00.135504 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14823): Process ended prematurely: osmo-stp_10.42.42.5(pid=14823) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14823)] [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:48:00.145049 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:48:00.172499 run osmo-hlr_10.42.42.2(pid=14820): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14820)] 23:48:00.223140 run osmo-hlr_10.42.42.2(pid=14820): stdout: | (launched: 2022-12-13_23:47:57.211575) 23:48:00.274941 run osmo-hlr_10.42.42.2(pid=14820): stderr: | [0;m[1;31m20221213234757410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234757410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234757410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234757410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234757411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234757411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234757421 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234757429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234757430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234757430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:00.348127 run osmo-msc_10.42.42.6(pid=14826): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14826)] 23:48:00.397835 run osmo-msc_10.42.42.6(pid=14826): stdout: | (launched: 2022-12-13_23:47:59.215415) 23:48:00.449711 run osmo-msc_10.42.42.6(pid=14826): stderr: | [0;m[38;5;43m20221213234759534 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234759534 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2922462c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234759534 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234759535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234759535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234759535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234759536 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234759537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234759537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234759537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:00.501742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14819): Terminating (SIGTERM) 23:48:00.542983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14822): Terminating (SIGTERM) 23:48:00.584528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14825): Terminating (SIGTERM) 23:48:00.626993 --- ParallelTerminationStrategy: PID 14819 died... 23:48:00.647076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14819): Terminated: ok {rc=0} 23:48:00.693373 --- ParallelTerminationStrategy: PID 14822 died... 23:48:00.713169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14822): Terminated: ok {rc=0} 23:48:00.758932 --- ParallelTerminationStrategy: PID 14825 died... 23:48:00.778743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14825): Terminated: ok {rc=0} 23:48:00.886215 bus /sierra_3: Setting Powered False 23:48:01.987688 bus /sierra_3: Setting Powered False 23:48:03.102957 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:48:04.365933 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:48:04.374272 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:48:04.407761 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:48:04.435923 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:48:04.495316 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:48:04.528717 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:48:04.556226 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:48:05.101566 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:48:05.150691 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:05.162070 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:48:05.230225 tst mo_mt_call.py: using LAC 37074 23:48:05.352029 tst mo_mt_call.py: using RAC 99 23:48:05.468169 tst mo_mt_call.py: using CellId 37074 23:48:05.583315 tst mo_mt_call.py: using BVCI 37075 23:48:05.691271 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:05.702395 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:05.713275 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:05.724024 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:05.734971 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:05.745950 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:48:05.865576 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:48:05.985169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:06.479148 run create_hlr_db(pid=14832): Launched 23:48:06.600915 bus /sierra_2: Setting Powered False 23:48:07.664281 run create_hlr_db(pid=14832): Terminated: ok {rc=0} 23:48:08.091337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14834): Launched 23:48:08.388679 run osmo-hlr_10.42.42.2(pid=14835): Launched 23:48:08.502909 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:09.018946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14837): Launched 23:48:09.315358 run osmo-stp_10.42.42.5(pid=14838): Launched 23:48:09.428623 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:09.966294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14840): Launched 23:48:10.263656 run osmo-msc_10.42.42.6(pid=14841): Launched 23:48:10.429216 run osmo-stp_10.42.42.5(pid=14838): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14838)] 23:48:10.554304 run osmo-stp_10.42.42.5(pid=14838): stdout: | (launched: 2022-12-13_23:48:09.261416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:10.679530 run osmo-stp_10.42.42.5(pid=14838): stderr: | [0;m[38;5;43m20221213234809431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234809431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234809432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234809432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234809433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234809433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234809433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:10.802950 run osmo-stp_10.42.42.5(pid=14838): stdout: | (launched: 2022-12-13_23:48:09.261416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:10.921424 run osmo-stp_10.42.42.5(pid=14838): stderr: | [0;m[38;5;43m20221213234809431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234809431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234809432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234809432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234809433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234809433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234809433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:11.062664 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14838): Process ended prematurely: osmo-stp_10.42.42.5(pid=14838) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14838)] [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:48:11.071415 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:48:11.097400 run osmo-hlr_10.42.42.2(pid=14835): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14835)] 23:48:11.144635 run osmo-hlr_10.42.42.2(pid=14835): stdout: | (launched: 2022-12-13_23:48:08.334255) 23:48:11.193611 run osmo-hlr_10.42.42.2(pid=14835): stderr: | [0;m[1;31m20221213234808513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234808513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234808513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234808513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234808513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234808513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234808524 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234808533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234808533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234808533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:11.261804 run osmo-msc_10.42.42.6(pid=14841): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14841)] 23:48:11.308752 run osmo-msc_10.42.42.6(pid=14841): stdout: | (launched: 2022-12-13_23:48:10.209248) 23:48:11.357621 run osmo-msc_10.42.42.6(pid=14841): stderr: | [0;m[38;5;43m20221213234810480 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234810481 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faefb9dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234810481 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234810481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234810481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234810481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234810483 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234810483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234810483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234810484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:11.406629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14834): Terminating (SIGTERM) 23:48:11.445757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14837): Terminating (SIGTERM) 23:48:11.484734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14840): Terminating (SIGTERM) 23:48:11.524006 --- ParallelTerminationStrategy: PID 14834 died... 23:48:11.543085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14834): Terminated: ok {rc=0} 23:48:11.586481 --- ParallelTerminationStrategy: PID 14837 died... 23:48:11.604805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14837): Terminated: ok {rc=0} 23:48:11.647993 --- ParallelTerminationStrategy: PID 14840 died... 23:48:11.666389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14840): Terminated: ok {rc=0} 23:48:11.749238 bus /sierra_3: Setting Powered False 23:48:12.847032 bus /sierra_3: Setting Powered False 23:48:13.962510 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:48:15.103107 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:15.114739 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:48:15.182826 tst mo_mt_call_osmux.py: using LAC 37075 23:48:15.299911 tst mo_mt_call_osmux.py: using RAC 100 23:48:15.416894 tst mo_mt_call_osmux.py: using CellId 37075 23:48:15.534054 tst mo_mt_call_osmux.py: using BVCI 37076 23:48:15.642808 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:15.654077 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:15.664917 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:15.675741 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:15.686658 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:15.697619 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:48:15.810928 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:48:15.939145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:16.428823 run create_hlr_db(pid=14843): Launched 23:48:16.575848 bus /sierra_2: Setting Powered False 23:48:17.635886 run create_hlr_db(pid=14843): Terminated: ok {rc=0} 23:48:18.072320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14845): Launched 23:48:18.391271 run osmo-hlr_10.42.42.2(pid=14846): Launched 23:48:18.512701 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:19.059752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14848): Launched 23:48:19.378352 run osmo-stp_10.42.42.5(pid=14849): Launched 23:48:19.500416 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:20.077039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14851): Launched 23:48:20.395496 run osmo-msc_10.42.42.6(pid=14852): Launched 23:48:20.572685 run osmo-stp_10.42.42.5(pid=14849): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14849)] 23:48:20.706381 run osmo-stp_10.42.42.5(pid=14849): stdout: | (launched: 2022-12-13_23:48:19.320291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:20.840871 run osmo-stp_10.42.42.5(pid=14849): stderr: | [0;m[38;5;43m20221213234819511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234819512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234819512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234819512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234819513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234819513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234819513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:20.975187 run osmo-stp_10.42.42.5(pid=14849): stdout: | (launched: 2022-12-13_23:48:19.320291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:21.102316 run osmo-stp_10.42.42.5(pid=14849): stderr: | [0;m[38;5;43m20221213234819511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234819512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234819512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234819512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234819513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234819513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234819513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:21.254281 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14849): Process ended prematurely: osmo-stp_10.42.42.5(pid=14849) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14849)] [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:48:21.263759 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:48:21.291118 run osmo-hlr_10.42.42.2(pid=14846): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14846)] 23:48:21.341719 run osmo-hlr_10.42.42.2(pid=14846): stdout: | (launched: 2022-12-13_23:48:18.333532) 23:48:21.393386 run osmo-hlr_10.42.42.2(pid=14846): stderr: | [0;m[1;31m20221213234818533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234818533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234818533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234818533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234818533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234818533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234818549 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234818559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234818559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234818559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:21.465534 run osmo-msc_10.42.42.6(pid=14852): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14852)] 23:48:21.514969 run osmo-msc_10.42.42.6(pid=14852): stdout: | (launched: 2022-12-13_23:48:20.337756) 23:48:21.566607 run osmo-msc_10.42.42.6(pid=14852): stderr: | [0;m[38;5;43m20221213234820661 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234820661 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9f25feec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234820661 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234820661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234820661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234820661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234820663 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234820664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234820664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234820664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:21.618323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14845): Terminating (SIGTERM) 23:48:21.659678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14848): Terminating (SIGTERM) 23:48:21.701190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14851): Terminating (SIGTERM) 23:48:21.742955 --- ParallelTerminationStrategy: PID 14845 died... 23:48:21.763103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14845): Terminated: ok {rc=0} 23:48:21.809091 --- ParallelTerminationStrategy: PID 14848 died... 23:48:21.828689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14848): Terminated: ok {rc=0} 23:48:21.874506 --- ParallelTerminationStrategy: PID 14851 died... 23:48:21.894378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14851): Terminated: ok {rc=0} 23:48:21.981984 bus /sierra_3: Setting Powered False 23:48:23.080226 bus /sierra_3: Setting Powered False 23:48:24.196692 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:48:25.447928 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:48:25.455150 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:48:25.486923 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:48:25.513407 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:48:25.565039 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:48:25.597822 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:48:25.625171 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:48:26.174316 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:48:26.223183 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:26.234389 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:48:26.302243 tst mo_mt_call.py: using LAC 37076 23:48:26.419918 tst mo_mt_call.py: using RAC 101 23:48:26.536917 tst mo_mt_call.py: using CellId 37076 23:48:26.654314 tst mo_mt_call.py: using BVCI 37077 23:48:26.763772 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:26.774786 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:26.785564 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:26.796349 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:26.807248 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:26.818618 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:48:26.932452 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:48:27.052009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:27.547333 run create_hlr_db(pid=14857): Launched 23:48:27.669674 bus /sierra_2: Setting Powered False 23:48:28.733182 run create_hlr_db(pid=14857): Terminated: ok {rc=0} 23:48:29.176866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14859): Launched 23:48:29.495524 run osmo-hlr_10.42.42.2(pid=14860): Launched 23:48:29.617725 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:30.165205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14862): Launched 23:48:30.484521 run osmo-stp_10.42.42.5(pid=14863): Launched 23:48:30.607004 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:31.233642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14865): Launched 23:48:31.577976 run osmo-msc_10.42.42.6(pid=14866): Launched 23:48:31.980404 run osmo-stp_10.42.42.5(pid=14863): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14863)] 23:48:32.186058 run osmo-stp_10.42.42.5(pid=14863): stdout: | (launched: 2022-12-13_23:48:30.426658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:32.488157 run osmo-stp_10.42.42.5(pid=14863): stderr: | [0;m[38;5;43m20221213234830620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234830620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234830620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234830621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234830621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234830621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234830621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:32.649503 run osmo-stp_10.42.42.5(pid=14863): stdout: | (launched: 2022-12-13_23:48:30.426658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:32.779359 run osmo-stp_10.42.42.5(pid=14863): stderr: | [0;m[38;5;43m20221213234830620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234830620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234830620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234830621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234830621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234830621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234830621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:32.932036 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14863): Process ended prematurely: osmo-stp_10.42.42.5(pid=14863) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14863)] [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:48:32.941600 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 23:48:32.969312 run osmo-hlr_10.42.42.2(pid=14860): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14860)] 23:48:33.020551 run osmo-hlr_10.42.42.2(pid=14860): stdout: | (launched: 2022-12-13_23:48:29.437966) 23:48:33.073314 run osmo-hlr_10.42.42.2(pid=14860): stderr: | [0;m[1;31m20221213234829634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234829634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234829634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234829634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234829634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234829634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234829646 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234829654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234829655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234829655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:33.146716 run osmo-msc_10.42.42.6(pid=14866): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14866)] 23:48:33.197466 run osmo-msc_10.42.42.6(pid=14866): stdout: | (launched: 2022-12-13_23:48:31.519335) 23:48:33.250034 run osmo-msc_10.42.42.6(pid=14866): stderr: | [0;m[38;5;43m20221213234832015 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234832016 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff227b7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234832016 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234832016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234832016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234832016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234832020 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234832021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234832022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234832022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:33.302664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14859): Terminating (SIGTERM) 23:48:33.345261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14862): Terminating (SIGTERM) 23:48:33.387465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14865): Terminating (SIGTERM) 23:48:33.430481 --- ParallelTerminationStrategy: PID 14859 died... 23:48:33.451105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14859): Terminated: ok {rc=0} 23:48:33.497812 --- ParallelTerminationStrategy: PID 14862 died... 23:48:33.517894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14862): Terminated: ok {rc=0} 23:48:33.564642 --- ParallelTerminationStrategy: PID 14865 died... 23:48:33.584766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14865): Terminated: ok {rc=0} 23:48:33.674179 bus /sierra_3: Setting Powered False 23:48:34.772167 bus /sierra_3: Setting Powered False 23:48:35.888461 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:48:37.037049 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:37.049098 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:48:37.129224 tst mo_mt_call_osmux.py: using LAC 37077 23:48:37.255047 tst mo_mt_call_osmux.py: using RAC 102 23:48:37.379146 tst mo_mt_call_osmux.py: using CellId 37077 23:48:37.502752 tst mo_mt_call_osmux.py: using BVCI 37078 23:48:37.618815 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:37.630422 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:37.641779 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:37.653078 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:37.664889 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:37.676462 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:48:37.793401 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:48:37.908835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:38.373867 run create_hlr_db(pid=14868): Launched 23:48:38.495848 bus /sierra_2: Setting Powered False 23:48:39.555431 run create_hlr_db(pid=14868): Terminated: ok {rc=0} 23:48:39.991872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14870): Launched 23:48:40.312046 run osmo-hlr_10.42.42.2(pid=14871): Launched 23:48:40.435127 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:40.982874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14873): Launched 23:48:41.301504 run osmo-stp_10.42.42.5(pid=14874): Launched 23:48:41.424895 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:42.004357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14876): Launched 23:48:42.324162 run osmo-msc_10.42.42.6(pid=14877): Launched 23:48:42.503447 run osmo-stp_10.42.42.5(pid=14874): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14874)] 23:48:42.638912 run osmo-stp_10.42.42.5(pid=14874): stdout: | (launched: 2022-12-13_23:48:41.243713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:42.775315 run osmo-stp_10.42.42.5(pid=14874): stderr: | [0;m[38;5;43m20221213234841433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234841434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234841434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234841434 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234841435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234841435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234841435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:42.910319 run osmo-stp_10.42.42.5(pid=14874): stdout: | (launched: 2022-12-13_23:48:41.243713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:43.038022 run osmo-stp_10.42.42.5(pid=14874): stderr: | [0;m[38;5;43m20221213234841433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234841434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234841434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234841434 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234841435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234841435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234841435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:43.190594 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14874): Process ended prematurely: osmo-stp_10.42.42.5(pid=14874) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14874)] [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:48:43.200154 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:48:43.227712 run osmo-hlr_10.42.42.2(pid=14871): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14871)] 23:48:43.278347 run osmo-hlr_10.42.42.2(pid=14871): stdout: | (launched: 2022-12-13_23:48:40.254204) 23:48:43.330066 run osmo-hlr_10.42.42.2(pid=14871): stderr: | [0;m[1;31m20221213234840452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234840452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234840452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234840452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234840452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234840453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234840509 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234840518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234840518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234840518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:43.402990 run osmo-msc_10.42.42.6(pid=14877): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14877)] 23:48:43.452779 run osmo-msc_10.42.42.6(pid=14877): stdout: | (launched: 2022-12-13_23:48:42.266363) 23:48:43.504642 run osmo-msc_10.42.42.6(pid=14877): stderr: | [0;m[38;5;43m20221213234842587 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234842587 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe9a663cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234842587 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234842587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234842587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234842587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234842589 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234842590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234842590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234842590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:43.557036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14870): Terminating (SIGTERM) 23:48:43.599025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14873): Terminating (SIGTERM) 23:48:43.641603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14876): Terminating (SIGTERM) 23:48:43.683982 --- ParallelTerminationStrategy: PID 14870 died... 23:48:43.704593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14870): Terminated: ok {rc=0} 23:48:43.751182 --- ParallelTerminationStrategy: PID 14873 died... 23:48:43.771049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14873): Terminated: ok {rc=0} 23:48:43.817412 --- ParallelTerminationStrategy: PID 14876 died... 23:48:43.837304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14876): Terminated: ok {rc=0} 23:48:43.925327 bus /sierra_3: Setting Powered False 23:48:45.023894 bus /sierra_3: Setting Powered False 23:48:46.155887 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:48:47.416573 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:48:47.422902 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:48:47.454690 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:48:47.481307 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:48:47.532924 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:48:47.566318 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:48:47.594325 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:48:48.145680 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:48:48.197604 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:48.209229 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:48:48.279566 tst mo_mt_call.py: using LAC 37078 23:48:48.404558 tst mo_mt_call.py: using RAC 103 23:48:48.531691 tst mo_mt_call.py: using CellId 37078 23:48:48.661997 tst mo_mt_call.py: using BVCI 37079 23:48:48.771627 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:48.782617 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:48.793592 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:48.804308 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:48.815273 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:48.826094 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:48:48.945716 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:48:49.065444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:49.526366 run create_hlr_db(pid=14882): Launched 23:48:49.650956 bus /sierra_2: Setting Powered False 23:48:50.714166 run create_hlr_db(pid=14882): Terminated: ok {rc=0} 23:48:51.141486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14884): Launched 23:48:51.439180 run osmo-hlr_10.42.42.2(pid=14885): Launched 23:48:51.552675 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:52.072080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14887): Launched 23:48:52.370653 run osmo-stp_10.42.42.5(pid=14888): Launched 23:48:52.484359 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:53.024482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14890): Launched 23:48:53.322106 run osmo-msc_10.42.42.6(pid=14891): Launched 23:48:53.488289 run osmo-stp_10.42.42.5(pid=14888): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14888)] 23:48:53.615290 run osmo-stp_10.42.42.5(pid=14888): stdout: | (launched: 2022-12-13_23:48:52.315524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:53.744802 run osmo-stp_10.42.42.5(pid=14888): stderr: | [0;m[38;5;43m20221213234852485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234852485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234852485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234852486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234852488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234852488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234852488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:53.868890 run osmo-stp_10.42.42.5(pid=14888): stdout: | (launched: 2022-12-13_23:48:52.315524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:53.987708 run osmo-stp_10.42.42.5(pid=14888): stderr: | [0;m[38;5;43m20221213234852485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234852485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234852485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234852486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234852488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234852488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234852488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:54.130254 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14888): Process ended prematurely: osmo-stp_10.42.42.5(pid=14888) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14888)] [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:48:54.139034 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:48:54.165262 run osmo-hlr_10.42.42.2(pid=14885): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14885)] 23:48:54.213174 run osmo-hlr_10.42.42.2(pid=14885): stdout: | (launched: 2022-12-13_23:48:51.385367) 23:48:54.262352 run osmo-hlr_10.42.42.2(pid=14885): stderr: | [0;m[1;31m20221213234851562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234851562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234851562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234851562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234851562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234851562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234851574 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234851584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234851585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234851585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:54.330945 run osmo-msc_10.42.42.6(pid=14891): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14891)] 23:48:54.378977 run osmo-msc_10.42.42.6(pid=14891): stdout: | (launched: 2022-12-13_23:48:53.267744) 23:48:54.428171 run osmo-msc_10.42.42.6(pid=14891): stderr: | [0;m[38;5;43m20221213234853540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234853540 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb43c7b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234853540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234853540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234853541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234853541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234853543 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234853543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234853543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234853543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:54.477663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14884): Terminating (SIGTERM) 23:48:54.516853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14887): Terminating (SIGTERM) 23:48:54.556101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14890): Terminating (SIGTERM) 23:48:54.595503 --- ParallelTerminationStrategy: PID 14884 died... 23:48:54.614533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14884): Terminated: ok {rc=0} 23:48:54.658218 --- ParallelTerminationStrategy: PID 14887 died... 23:48:54.676653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14887): Terminated: ok {rc=0} 23:48:54.720138 --- ParallelTerminationStrategy: PID 14890 died... 23:48:54.738635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14890): Terminated: ok {rc=0} 23:48:54.824078 bus /sierra_3: Setting Powered False 23:48:55.924141 bus /sierra_3: Setting Powered False 23:48:57.039086 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:48:58.184120 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:58.195656 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:48:58.264123 tst mo_mt_call_osmux.py: using LAC 37079 23:48:58.383378 tst mo_mt_call_osmux.py: using RAC 104 23:48:58.502511 tst mo_mt_call_osmux.py: using CellId 37079 23:48:58.620792 tst mo_mt_call_osmux.py: using BVCI 37080 23:48:58.729206 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:58.740103 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:58.750966 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:58.761777 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:58.772592 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:58.783445 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:48:58.903086 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:48:59.019307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:59.513598 run create_hlr_db(pid=14893): Launched 23:48:59.635909 bus /sierra_2: Setting Powered False 23:49:00.698641 run create_hlr_db(pid=14893): Terminated: ok {rc=0} 23:49:01.154934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14895): Launched 23:49:01.489639 run osmo-hlr_10.42.42.2(pid=14896): Launched 23:49:01.740610 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:02.480216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14898): Launched 23:49:02.797723 run osmo-stp_10.42.42.5(pid=14899): Launched 23:49:02.919213 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:03.493717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14901): Launched 23:49:03.810352 run osmo-msc_10.42.42.6(pid=14902): Launched 23:49:03.986982 run osmo-stp_10.42.42.5(pid=14899): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14899)] 23:49:04.121546 run osmo-stp_10.42.42.5(pid=14899): stdout: | (launched: 2022-12-13_23:49:02.740389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:04.256395 run osmo-stp_10.42.42.5(pid=14899): stderr: | [0;m[38;5;43m20221213234902933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234902933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234902933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234902934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234902934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234902934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234902934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:04.391100 run osmo-stp_10.42.42.5(pid=14899): stdout: | (launched: 2022-12-13_23:49:02.740389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:04.518448 run osmo-stp_10.42.42.5(pid=14899): stderr: | [0;m[38;5;43m20221213234902933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234902933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234902933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234902934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234902934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234902934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234902934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:04.669704 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14899): Process ended prematurely: osmo-stp_10.42.42.5(pid=14899) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14899)] [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:49:04.679104 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:49:04.706488 run osmo-hlr_10.42.42.2(pid=14896): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14896)] 23:49:04.756589 run osmo-hlr_10.42.42.2(pid=14896): stdout: | (launched: 2022-12-13_23:49:01.427386) 23:49:04.807899 run osmo-hlr_10.42.42.2(pid=14896): stderr: | [0;m[1;31m20221213234901728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234901728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234901728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234901728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234901728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234901729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234901742 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234901756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234901759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234901759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:04.880073 run osmo-msc_10.42.42.6(pid=14902): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14902)] 23:49:04.929362 run osmo-msc_10.42.42.6(pid=14902): stdout: | (launched: 2022-12-13_23:49:03.752730) 23:49:04.980556 run osmo-msc_10.42.42.6(pid=14902): stderr: | [0;m[38;5;43m20221213234904079 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234904079 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2d3fabec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234904080 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234904080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234904080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234904080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234904082 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234904082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234904082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234904082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:05.032503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14895): Terminating (SIGTERM) 23:49:05.073511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14898): Terminating (SIGTERM) 23:49:05.115319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14901): Terminating (SIGTERM) 23:49:05.157585 --- ParallelTerminationStrategy: PID 14895 died... 23:49:05.177727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14895): Terminated: ok {rc=0} 23:49:05.223581 --- ParallelTerminationStrategy: PID 14898 died... 23:49:05.242921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14898): Terminated: ok {rc=0} 23:49:05.288616 --- ParallelTerminationStrategy: PID 14901 died... 23:49:05.308347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14901): Terminated: ok {rc=0} 23:49:05.395315 bus /sierra_3: Setting Powered False 23:49:06.492414 bus /sierra_3: Setting Powered False 23:49:07.607368 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:49:08.857277 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:49:08.864112 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:49:08.897121 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:49:08.925931 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:49:08.979122 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:49:09.012570 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:49:09.040457 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:49:09.590798 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:49:09.642730 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:09.654397 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:49:09.724670 tst mo_mt_call.py: using LAC 37080 23:49:09.850229 tst mo_mt_call.py: using RAC 105 23:49:09.976617 tst mo_mt_call.py: using CellId 37080 23:49:10.095119 tst mo_mt_call.py: using BVCI 37081 23:49:10.204666 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:10.216046 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:10.226858 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:10.237890 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:10.248930 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:10.259902 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:49:10.373647 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:49:10.492063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:10.985054 run create_hlr_db(pid=14908): Launched 23:49:11.107145 bus /sierra_2: Setting Powered False 23:49:12.170139 run create_hlr_db(pid=14908): Terminated: ok {rc=0} 23:49:12.596483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14910): Launched 23:49:12.893031 run osmo-hlr_10.42.42.2(pid=14911): Launched 23:49:13.006827 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:13.517487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14913): Launched 23:49:13.814380 run osmo-stp_10.42.42.5(pid=14914): Launched 23:49:13.927453 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:14.464303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14916): Launched 23:49:14.761729 run osmo-msc_10.42.42.6(pid=14917): Launched 23:49:14.927734 run osmo-stp_10.42.42.5(pid=14914): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14914)] 23:49:15.053147 run osmo-stp_10.42.42.5(pid=14914): stdout: | (launched: 2022-12-13_23:49:13.759153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:15.179009 run osmo-stp_10.42.42.5(pid=14914): stderr: | [0;m[38;5;43m20221213234913930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234913930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234913930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234913931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234913931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234913931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234913931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:15.302311 run osmo-stp_10.42.42.5(pid=14914): stdout: | (launched: 2022-12-13_23:49:13.759153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:15.420616 run osmo-stp_10.42.42.5(pid=14914): stderr: | [0;m[38;5;43m20221213234913930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234913930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234913930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234913931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234913931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234913931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234913931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:15.562408 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14914): Process ended prematurely: osmo-stp_10.42.42.5(pid=14914) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14914)] [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:49:15.571322 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:49:15.597565 run osmo-hlr_10.42.42.2(pid=14911): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14911)] 23:49:15.644936 run osmo-hlr_10.42.42.2(pid=14911): stdout: | (launched: 2022-12-13_23:49:12.839122) 23:49:15.693840 run osmo-hlr_10.42.42.2(pid=14911): stderr: | [0;m[1;31m20221213234913016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234913016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234913016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234913016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234913016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234913016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234913028 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234913039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234913039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234913039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:15.761838 run osmo-msc_10.42.42.6(pid=14917): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14917)] 23:49:15.808940 run osmo-msc_10.42.42.6(pid=14917): stdout: | (launched: 2022-12-13_23:49:14.707454) 23:49:15.865999 run osmo-msc_10.42.42.6(pid=14917): stderr: | [0;m[38;5;43m20221213234914978 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234914979 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f58d6e25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234914979 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234914979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234914979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234914979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234914981 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234914981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234914982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234914982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:15.922242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14910): Terminating (SIGTERM) 23:49:15.962336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14913): Terminating (SIGTERM) 23:49:16.002644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14916): Terminating (SIGTERM) 23:49:16.043266 --- ParallelTerminationStrategy: PID 14910 died... 23:49:16.062663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14910): Terminated: ok {rc=0} 23:49:16.107747 --- ParallelTerminationStrategy: PID 14913 died... 23:49:16.127344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14913): Terminated: ok {rc=0} 23:49:16.172236 --- ParallelTerminationStrategy: PID 14916 died... 23:49:16.191643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14916): Terminated: ok {rc=0} 23:49:16.275058 bus /sierra_3: Setting Powered False 23:49:17.368149 bus /sierra_3: Setting Powered False 23:49:18.481859 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:49:19.626439 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:19.638296 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:49:19.706583 tst mo_mt_call_osmux.py: using LAC 37081 23:49:19.825367 tst mo_mt_call_osmux.py: using RAC 106 23:49:19.942689 tst mo_mt_call_osmux.py: using CellId 37081 23:49:20.073458 tst mo_mt_call_osmux.py: using BVCI 37082 23:49:20.190529 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:20.202338 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:20.214094 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:20.225755 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:20.237817 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:20.249521 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:49:20.366131 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:49:20.481538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:20.944692 run create_hlr_db(pid=14919): Launched 23:49:21.067557 bus /sierra_2: Setting Powered False 23:49:22.127250 run create_hlr_db(pid=14919): Terminated: ok {rc=0} 23:49:22.545166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14921): Launched 23:49:22.844542 run osmo-hlr_10.42.42.2(pid=14922): Launched 23:49:22.958289 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:23.484824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14924): Launched 23:49:23.783330 run osmo-stp_10.42.42.5(pid=14925): Launched 23:49:23.896102 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:24.436145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14927): Launched 23:49:24.734402 run osmo-msc_10.42.42.6(pid=14928): Launched 23:49:24.900851 run osmo-stp_10.42.42.5(pid=14925): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14925)] 23:49:25.026700 run osmo-stp_10.42.42.5(pid=14925): stdout: | (launched: 2022-12-13_23:49:23.728590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:25.153395 run osmo-stp_10.42.42.5(pid=14925): stderr: | [0;m[38;5;43m20221213234923899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234923900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234923900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234923900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234923902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234923903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234923903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:25.277657 run osmo-stp_10.42.42.5(pid=14925): stdout: | (launched: 2022-12-13_23:49:23.728590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:25.396508 run osmo-stp_10.42.42.5(pid=14925): stderr: | [0;m[38;5;43m20221213234923899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234923900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234923900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234923900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234923902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234923903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234923903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:25.538540 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14925): Process ended prematurely: osmo-stp_10.42.42.5(pid=14925) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14925)] [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:49:25.547517 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:49:25.573808 run osmo-hlr_10.42.42.2(pid=14922): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14922)] 23:49:25.621280 run osmo-hlr_10.42.42.2(pid=14922): stdout: | (launched: 2022-12-13_23:49:22.789800) 23:49:25.670466 run osmo-hlr_10.42.42.2(pid=14922): stderr: | [0;m[1;31m20221213234922967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234922967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234922967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234922967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234922967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234922967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234922979 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234922988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234922989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234922989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:25.739146 run osmo-msc_10.42.42.6(pid=14928): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14928)] 23:49:25.786242 run osmo-msc_10.42.42.6(pid=14928): stdout: | (launched: 2022-12-13_23:49:24.679835) 23:49:25.835037 run osmo-msc_10.42.42.6(pid=14928): stderr: | [0;m[38;5;43m20221213234924952 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234924953 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb1d7ebfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234924953 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234924953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234924953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234924953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234924955 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234924955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234924956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234924956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:25.883889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14921): Terminating (SIGTERM) 23:49:25.923003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14924): Terminating (SIGTERM) 23:49:25.962067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14927): Terminating (SIGTERM) 23:49:26.001603 --- ParallelTerminationStrategy: PID 14921 died... 23:49:26.020841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14921): Terminated: ok {rc=0} 23:49:26.064701 --- ParallelTerminationStrategy: PID 14924 died... 23:49:26.083352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14924): Terminated: ok {rc=0} 23:49:26.126963 --- ParallelTerminationStrategy: PID 14927 died... 23:49:26.145428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14927): Terminated: ok {rc=0} 23:49:26.231040 bus /sierra_3: Setting Powered False 23:49:27.330563 bus /sierra_3: Setting Powered False 23:49:28.443554 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:49:29.693156 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:49:29.699374 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:49:29.730992 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:49:29.757225 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:49:29.807626 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:49:29.839750 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:49:29.865909 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:49:30.418581 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:49:30.466748 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:30.478017 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:49:30.546145 tst mo_mt_call.py: using LAC 37082 23:49:30.663110 tst mo_mt_call.py: using RAC 107 23:49:30.782086 tst mo_mt_call.py: using CellId 37082 23:49:30.911488 tst mo_mt_call.py: using BVCI 37083 23:49:31.021467 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:31.034535 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:31.048175 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:31.063361 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:31.077641 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:31.093146 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:49:31.219933 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:49:31.339203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:31.851762 run create_hlr_db(pid=14934): Launched 23:49:32.007500 bus /sierra_2: Setting Powered False 23:49:33.070308 run create_hlr_db(pid=14934): Terminated: ok {rc=0} 23:49:33.501124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14936): Launched 23:49:33.800293 run osmo-hlr_10.42.42.2(pid=14937): Launched 23:49:33.914507 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:34.431010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14939): Launched 23:49:34.729666 run osmo-stp_10.42.42.5(pid=14940): Launched 23:49:34.842588 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:35.380843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14942): Launched 23:49:35.679012 run osmo-msc_10.42.42.6(pid=14943): Launched 23:49:35.845715 run osmo-stp_10.42.42.5(pid=14940): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14940)] 23:49:35.971899 run osmo-stp_10.42.42.5(pid=14940): stdout: | (launched: 2022-12-13_23:49:34.674877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:36.098458 run osmo-stp_10.42.42.5(pid=14940): stderr: | [0;m[38;5;43m20221213234934846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234934846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234934846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234934847 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234934847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234934847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234934847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:36.223108 run osmo-stp_10.42.42.5(pid=14940): stdout: | (launched: 2022-12-13_23:49:34.674877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:36.341962 run osmo-stp_10.42.42.5(pid=14940): stderr: | [0;m[38;5;43m20221213234934846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234934846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234934846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234934847 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234934847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234934847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234934847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:36.484037 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14940): Process ended prematurely: osmo-stp_10.42.42.5(pid=14940) [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14940)] [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:49:36.493027 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:49:36.519299 run osmo-hlr_10.42.42.2(pid=14937): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14937)] 23:49:36.566449 run osmo-hlr_10.42.42.2(pid=14937): stdout: | (launched: 2022-12-13_23:49:33.745708) 23:49:36.615495 run osmo-hlr_10.42.42.2(pid=14937): stderr: | [0;m[1;31m20221213234933924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234933924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234933924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234933924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234933924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234933924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234933936 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234933945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234933945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234933945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:36.684312 run osmo-msc_10.42.42.6(pid=14943): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14943)] 23:49:36.731738 run osmo-msc_10.42.42.6(pid=14943): stdout: | (launched: 2022-12-13_23:49:35.624489) 23:49:36.780337 run osmo-msc_10.42.42.6(pid=14943): stderr: | [0;m[38;5;43m20221213234935894 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234935894 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4cf6b5ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234935894 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234935894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234935895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234935895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234935896 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234935897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234935897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234935897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:36.829414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14936): Terminating (SIGTERM) 23:49:36.868215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14939): Terminating (SIGTERM) 23:49:36.907151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14942): Terminating (SIGTERM) 23:49:36.946709 --- ParallelTerminationStrategy: PID 14936 died... 23:49:36.965842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14936): Terminated: ok {rc=0} 23:49:37.009194 --- ParallelTerminationStrategy: PID 14939 died... 23:49:37.027668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14939): Terminated: ok {rc=0} 23:49:37.070907 --- ParallelTerminationStrategy: PID 14942 died... 23:49:37.089555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14942): Terminated: ok {rc=0} 23:49:37.172055 bus /sierra_3: Setting Powered False 23:49:38.269305 bus /sierra_3: Setting Powered False 23:49:39.387607 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:49:40.531797 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:40.543740 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:49:40.612922 tst mo_mt_call_osmux.py: using LAC 37083 23:49:40.738827 tst mo_mt_call_osmux.py: using RAC 108 23:49:40.865877 tst mo_mt_call_osmux.py: using CellId 37083 23:49:40.983641 tst mo_mt_call_osmux.py: using BVCI 37084 23:49:41.092824 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:41.104387 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:41.115564 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:41.126681 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:41.137989 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:41.149365 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:49:41.266122 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:49:41.385881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:41.881089 run create_hlr_db(pid=14945): Launched 23:49:42.003347 bus /sierra_2: Setting Powered False 23:49:43.067007 run create_hlr_db(pid=14945): Terminated: ok {rc=0} 23:49:43.495400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14947): Launched 23:49:43.794480 run osmo-hlr_10.42.42.2(pid=14948): Launched 23:49:43.908550 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:44.439933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14950): Launched 23:49:44.737821 run osmo-stp_10.42.42.5(pid=14951): Launched 23:49:44.852263 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:45.391139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14953): Launched 23:49:45.688571 run osmo-msc_10.42.42.6(pid=14954): Launched 23:49:45.910636 run osmo-stp_10.42.42.5(pid=14951): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14951)] 23:49:46.200379 run osmo-stp_10.42.42.5(pid=14951): stdout: | (launched: 2022-12-13_23:49:44.683056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:46.337957 run osmo-stp_10.42.42.5(pid=14951): stderr: | [0;m[38;5;43m20221213234944853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234944853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234944854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234944854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234944855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234944855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234944855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:46.476368 run osmo-stp_10.42.42.5(pid=14951): stdout: | (launched: 2022-12-13_23:49:44.683056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:46.607879 run osmo-stp_10.42.42.5(pid=14951): stderr: | [0;m[38;5;43m20221213234944853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234944853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234944854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234944854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234944855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234944855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234944855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:46.765575 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14951): Process ended prematurely: osmo-stp_10.42.42.5(pid=14951) [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14951)] [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:49:46.776195 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:49:46.805167 run osmo-hlr_10.42.42.2(pid=14948): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14948)] 23:49:46.861867 run osmo-hlr_10.42.42.2(pid=14948): stdout: | (launched: 2022-12-13_23:49:43.740267) 23:49:46.916263 run osmo-hlr_10.42.42.2(pid=14948): stderr: | [0;m[1;31m20221213234943918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234943918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234943918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234943918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234943918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234943918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234943930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234943939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234943939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234943939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:46.991932 run osmo-msc_10.42.42.6(pid=14954): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14954)] 23:49:47.046246 run osmo-msc_10.42.42.6(pid=14954): stdout: | (launched: 2022-12-13_23:49:45.634109) 23:49:47.100617 run osmo-msc_10.42.42.6(pid=14954): stderr: | [0;m[38;5;43m20221213234945960 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234945960 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4daa412c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234945960 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234945960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234945960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234945961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234945963 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234945964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234945964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234945964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:47.155019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14947): Terminating (SIGTERM) 23:49:47.198556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14950): Terminating (SIGTERM) 23:49:47.240706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14953): Terminating (SIGTERM) 23:49:47.280039 --- ParallelTerminationStrategy: PID 14947 died... 23:49:47.298933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14947): Terminated: ok {rc=0} 23:49:47.342114 --- ParallelTerminationStrategy: PID 14950 died... 23:49:47.360595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14950): Terminated: ok {rc=0} 23:49:47.403791 --- ParallelTerminationStrategy: PID 14953 died... 23:49:47.422132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14953): Terminated: ok {rc=0} 23:49:47.502936 bus /sierra_3: Setting Powered False 23:49:48.599644 bus /sierra_3: Setting Powered False 23:49:49.714534 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:49:50.971004 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:49:50.977097 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:49:51.009978 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:49:51.038272 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:49:51.090061 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:49:51.122086 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:49:51.148812 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:49:51.705664 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:49:51.757268 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:51.768404 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:49:51.837381 tst mo_mt_call.py: using LAC 37084 23:49:51.959806 tst mo_mt_call.py: using RAC 109 23:49:52.086463 tst mo_mt_call.py: using CellId 37084 23:49:52.223340 tst mo_mt_call.py: using BVCI 37085 23:49:52.340082 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:52.351388 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:52.362548 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:52.373668 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:52.385453 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:52.396792 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:49:52.513941 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:49:52.632648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:53.124884 run create_hlr_db(pid=14959): Launched 23:49:53.246632 bus /sierra_2: Setting Powered False 23:49:54.309386 run create_hlr_db(pid=14959): Terminated: ok {rc=0} 23:49:54.735677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14961): Launched 23:49:55.035237 run osmo-hlr_10.42.42.2(pid=14962): Launched 23:49:55.151293 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:55.667905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14964): Launched 23:49:55.964790 run osmo-stp_10.42.42.5(pid=14965): Launched 23:49:56.078390 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:56.617989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14967): Launched 23:49:56.916255 run osmo-msc_10.42.42.6(pid=14968): Launched 23:49:57.082988 run osmo-stp_10.42.42.5(pid=14965): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14965)] 23:49:57.210391 run osmo-stp_10.42.42.5(pid=14965): stdout: | (launched: 2022-12-13_23:49:55.910297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:57.336129 run osmo-stp_10.42.42.5(pid=14965): stderr: | [0;m[38;5;43m20221213234956084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234956084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234956084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234956084 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234956085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234956085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234956085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:57.459984 run osmo-stp_10.42.42.5(pid=14965): stdout: | (launched: 2022-12-13_23:49:55.910297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:57.578753 run osmo-stp_10.42.42.5(pid=14965): stderr: | [0;m[38;5;43m20221213234956084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213234956084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213234956084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213234956084 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213234956085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213234956085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213234956085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:57.720665 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14965): Process ended prematurely: osmo-stp_10.42.42.5(pid=14965) [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14965)] [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:49:57.729446 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:49:57.755367 run osmo-hlr_10.42.42.2(pid=14962): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14962)] 23:49:57.802753 run osmo-hlr_10.42.42.2(pid=14962): stdout: | (launched: 2022-12-13_23:49:54.980171) 23:49:57.851408 run osmo-hlr_10.42.42.2(pid=14962): stderr: | [0;m[1;31m20221213234955155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213234955156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213234955156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213234955156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213234955156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213234955156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213234955167 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213234955176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213234955176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213234955176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:57.919919 run osmo-msc_10.42.42.6(pid=14968): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14968)] 23:49:57.966888 run osmo-msc_10.42.42.6(pid=14968): stdout: | (launched: 2022-12-13_23:49:56.861182) 23:49:58.015415 run osmo-msc_10.42.42.6(pid=14968): stderr: | [0;m[38;5;43m20221213234957133 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213234957133 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fef8871fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213234957133 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213234957134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213234957134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213234957134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213234957136 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213234957136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213234957136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213234957136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:58.064445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14961): Terminating (SIGTERM) 23:49:58.103672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14964): Terminating (SIGTERM) 23:49:58.143019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14967): Terminating (SIGTERM) 23:49:58.182766 --- ParallelTerminationStrategy: PID 14961 died... 23:49:58.201915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14961): Terminated: ok {rc=0} 23:49:58.245881 --- ParallelTerminationStrategy: PID 14964 died... 23:49:58.264583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14964): Terminated: ok {rc=0} 23:49:58.308382 --- ParallelTerminationStrategy: PID 14967 died... 23:49:58.327110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14967): Terminated: ok {rc=0} 23:49:58.412368 bus /sierra_3: Setting Powered False 23:49:59.510493 bus /sierra_3: Setting Powered False 23:50:00.624169 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:50:01.767602 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:50:01.779632 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:50:01.850337 tst mo_mt_call_osmux.py: using LAC 37085 23:50:02.010174 tst mo_mt_call_osmux.py: using RAC 110 23:50:02.176911 tst mo_mt_call_osmux.py: using CellId 37085 23:50:02.311902 tst mo_mt_call_osmux.py: using BVCI 37086 23:50:02.421701 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:50:02.432580 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:50:02.443325 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:50:02.453981 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:50:02.465183 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:50:02.476500 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:50:02.595998 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:50:02.716228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:03.181524 run create_hlr_db(pid=14973): Launched 23:50:03.303657 bus /sierra_2: Setting Powered False 23:50:04.363767 run create_hlr_db(pid=14973): Terminated: ok {rc=0} 23:50:04.799691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14975): Launched 23:50:05.119281 run osmo-hlr_10.42.42.2(pid=14976): Launched 23:50:05.241311 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:05.794632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14978): Launched 23:50:06.112399 run osmo-stp_10.42.42.5(pid=14979): Launched 23:50:06.233818 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:06.815708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14981): Launched 23:50:07.120750 run osmo-msc_10.42.42.6(pid=14982): Launched 23:50:07.288099 run osmo-stp_10.42.42.5(pid=14979): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14979)] 23:50:07.413625 run osmo-stp_10.42.42.5(pid=14979): stdout: | (launched: 2022-12-13_23:50:06.054420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:07.540187 run osmo-stp_10.42.42.5(pid=14979): stderr: | [0;m[38;5;43m20221213235006246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235006247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235006247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235006247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235006248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235006248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235006248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:07.664866 run osmo-stp_10.42.42.5(pid=14979): stdout: | (launched: 2022-12-13_23:50:06.054420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:07.783540 run osmo-stp_10.42.42.5(pid=14979): stderr: | [0;m[38;5;43m20221213235006246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235006247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235006247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235006247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235006248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235006248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235006248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:07.926169 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14979): Process ended prematurely: osmo-stp_10.42.42.5(pid=14979) [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14979)] [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:50:07.934876 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:50:07.961144 run osmo-hlr_10.42.42.2(pid=14976): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14976)] 23:50:08.008621 run osmo-hlr_10.42.42.2(pid=14976): stdout: | (launched: 2022-12-13_23:50:05.061672) 23:50:08.057714 run osmo-hlr_10.42.42.2(pid=14976): stderr: | [0;m[1;31m20221213235005257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235005257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235005257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235005257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235005257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235005257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235005269 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235005278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235005278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235005278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:08.126138 run osmo-msc_10.42.42.6(pid=14982): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14982)] 23:50:08.173418 run osmo-msc_10.42.42.6(pid=14982): stdout: | (launched: 2022-12-13_23:50:07.066132) 23:50:08.222369 run osmo-msc_10.42.42.6(pid=14982): stderr: | [0;m[38;5;43m20221213235007337 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235007338 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff05c783c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235007338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235007338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235007338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235007338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235007340 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235007340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235007340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235007340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:08.271762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14975): Terminating (SIGTERM) 23:50:08.311275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14978): Terminating (SIGTERM) 23:50:08.350711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14981): Terminating (SIGTERM) 23:50:08.390393 --- ParallelTerminationStrategy: PID 14975 died... 23:50:08.409497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14975): Terminated: ok {rc=0} 23:50:08.453409 --- ParallelTerminationStrategy: PID 14978 died... 23:50:08.471882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14978): Terminated: ok {rc=0} 23:50:08.515947 --- ParallelTerminationStrategy: PID 14981 died... 23:50:08.534667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14981): Terminated: ok {rc=0} 23:50:08.620362 bus /sierra_3: Setting Powered False 23:50:09.720767 bus /sierra_3: Setting Powered False 23:50:10.834669 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:50:12.080256 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:50:12.086117 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:50:12.117856 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 23:50:12.144250 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 23:50:12.194881 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:50:12.226956 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 23:50:12.253252 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 23:50:12.809188 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 23:50:12.861089 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:12.872891 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:50:12.926496 tst mo_mt_call.py: using LAC 37086 23:50:13.056203 tst mo_mt_call.py: using RAC 111 23:50:13.181908 tst mo_mt_call.py: using CellId 37086 23:50:13.299242 tst mo_mt_call.py: using BVCI 37087 23:50:13.409537 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:13.421026 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:13.432366 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:13.443564 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:13.455044 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:13.466311 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:50:13.582471 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:50:13.702834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:14.167694 run create_hlr_db(pid=14987): Launched 23:50:14.290401 bus /sierra_2: Setting Powered False 23:50:15.350194 run create_hlr_db(pid=14987): Terminated: ok {rc=0} 23:50:15.787510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14989): Launched 23:50:16.155039 run osmo-hlr_10.42.42.2(pid=14990): Launched 23:50:16.401514 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:17.183537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14992): Launched 23:50:17.524322 run osmo-stp_10.42.42.5(pid=14993): Launched 23:50:17.648280 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:18.227281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14995): Launched 23:50:18.548778 run osmo-msc_10.42.42.6(pid=14996): Launched 23:50:18.727231 run osmo-stp_10.42.42.5(pid=14993): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14993)] 23:50:18.862382 run osmo-stp_10.42.42.5(pid=14993): stdout: | (launched: 2022-12-13_23:50:17.466453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:18.999129 run osmo-stp_10.42.42.5(pid=14993): stderr: | [0;m[38;5;43m20221213235017656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235017656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235017657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235017657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235017659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235017660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235017660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:19.135297 run osmo-stp_10.42.42.5(pid=14993): stdout: | (launched: 2022-12-13_23:50:17.466453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:19.262900 run osmo-stp_10.42.42.5(pid=14993): stderr: | [0;m[38;5;43m20221213235017656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235017656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235017657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235017657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235017659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235017660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235017660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:19.415720 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14993): Process ended prematurely: osmo-stp_10.42.42.5(pid=14993) [trial-2396↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14993)] [trial-2396↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 23:50:19.425240 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 23:50:19.452897 run osmo-hlr_10.42.42.2(pid=14990): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14990)] 23:50:19.503589 run osmo-hlr_10.42.42.2(pid=14990): stdout: | (launched: 2022-12-13_23:50:16.088003) 23:50:19.555915 run osmo-hlr_10.42.42.2(pid=14990): stderr: | [0;m[1;31m20221213235016535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235016535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235016535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235016535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235016535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235016535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235016558 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235016584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235016584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235016584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:19.628287 run osmo-msc_10.42.42.6(pid=14996): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14996)] 23:50:19.678097 run osmo-msc_10.42.42.6(pid=14996): stdout: | (launched: 2022-12-13_23:50:18.490637) 23:50:19.729838 run osmo-msc_10.42.42.6(pid=14996): stderr: | [0;m[38;5;43m20221213235018810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235018810 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fca3fe4dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235018810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235018811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235018811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235018811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235018813 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235018813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235018813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235018813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:19.781972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14989): Terminating (SIGTERM) 23:50:19.823758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14992): Terminating (SIGTERM) 23:50:19.866022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14995): Terminating (SIGTERM) 23:50:19.908462 --- ParallelTerminationStrategy: PID 14989 died... 23:50:19.928931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14989): Terminated: ok {rc=0} 23:50:19.975395 --- ParallelTerminationStrategy: PID 14992 died... 23:50:19.995277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14992): Terminated: ok {rc=0} 23:50:20.041303 --- ParallelTerminationStrategy: PID 14995 died... 23:50:20.061204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14995): Terminated: ok {rc=0} 23:50:20.149343 bus /sierra_3: Setting Powered False 23:50:21.247211 bus /sierra_3: Setting Powered False 23:50:22.364197 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 23:50:23.512460 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:23.524745 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:50:23.577908 tst mo_mt_call_osmux.py: using LAC 37087 23:50:23.705277 tst mo_mt_call_osmux.py: using RAC 112 23:50:23.823936 tst mo_mt_call_osmux.py: using CellId 37087 23:50:23.941542 tst mo_mt_call_osmux.py: using BVCI 37088 23:50:24.049820 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:24.061251 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:24.072406 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:24.083718 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:24.095198 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:24.106516 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:50:24.226307 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:50:24.344257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:24.841496 run create_hlr_db(pid=14998): Launched 23:50:24.963699 bus /sierra_2: Setting Powered False 23:50:26.026429 run create_hlr_db(pid=14998): Terminated: ok {rc=0} 23:50:26.454096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15000): Launched 23:50:26.752473 run osmo-hlr_10.42.42.2(pid=15001): Launched 23:50:26.866383 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:27.379996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15003): Launched 23:50:27.677887 run osmo-stp_10.42.42.5(pid=15004): Launched 23:50:27.791761 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:28.331066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15006): Launched 23:50:28.628516 run osmo-msc_10.42.42.6(pid=15007): Launched 23:50:28.796044 run osmo-stp_10.42.42.5(pid=15004): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15004)] 23:50:28.922039 run osmo-stp_10.42.42.5(pid=15004): stdout: | (launched: 2022-12-13_23:50:27.623813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:29.048400 run osmo-stp_10.42.42.5(pid=15004): stderr: | [0;m[38;5;43m20221213235027792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235027792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235027792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235027793 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235027793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235027793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235027793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:29.172913 run osmo-stp_10.42.42.5(pid=15004): stdout: | (launched: 2022-12-13_23:50:27.623813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:29.291500 run osmo-stp_10.42.42.5(pid=15004): stderr: | [0;m[38;5;43m20221213235027792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235027792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235027792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235027793 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235027793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235027793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235027793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:29.433691 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15004): Process ended prematurely: osmo-stp_10.42.42.5(pid=15004) [trial-2396↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15004)] [trial-2396↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 23:50:29.442508 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:50:29.468205 run osmo-hlr_10.42.42.2(pid=15001): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15001)] 23:50:29.515683 run osmo-hlr_10.42.42.2(pid=15001): stdout: | (launched: 2022-12-13_23:50:26.697933) 23:50:29.564569 run osmo-hlr_10.42.42.2(pid=15001): stderr: | [0;m[1;31m20221213235026875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235026875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235026875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235026875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235026875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235026875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235026887 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235026898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235026898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235026898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:29.632515 run osmo-msc_10.42.42.6(pid=15007): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15007)] 23:50:29.679368 run osmo-msc_10.42.42.6(pid=15007): stdout: | (launched: 2022-12-13_23:50:28.574172) 23:50:29.728392 run osmo-msc_10.42.42.6(pid=15007): stderr: | [0;m[38;5;43m20221213235028847 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235028847 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6eb3bc3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235028847 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235028847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235028847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235028848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235028849 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235028850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235028850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235028850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:29.777579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15000): Terminating (SIGTERM) 23:50:29.816444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15003): Terminating (SIGTERM) 23:50:29.855296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15006): Terminating (SIGTERM) 23:50:29.894298 --- ParallelTerminationStrategy: PID 15000 died... 23:50:29.913330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15000): Terminated: ok {rc=0} 23:50:29.956789 --- ParallelTerminationStrategy: PID 15003 died... 23:50:29.975404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15003): Terminated: ok {rc=0} 23:50:30.018652 --- ParallelTerminationStrategy: PID 15006 died... 23:50:30.037174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15006): Terminated: ok {rc=0} 23:50:30.122205 bus /sierra_3: Setting Powered False 23:50:31.220822 bus /sierra_3: Setting Powered False 23:50:32.334024 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 emergency:trx-umtrx --------------------------------------------------------------------- 23:50:33.586216 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:50:33.590502 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:50:33.622116 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:50:33.648642 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 23:50:33.730302 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:50:33.762220 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:50:33.788683 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 23:50:34.373885 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2396 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 23:50:34.380378 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:34.392504 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 23:50:34.442581 tst emergency_mo_mt_call.py: using LAC 37088 23:50:34.565643 tst emergency_mo_mt_call.py: using RAC 113 23:50:34.679754 tst emergency_mo_mt_call.py: using CellId 37088 23:50:34.793566 tst emergency_mo_mt_call.py: using BVCI 37089 23:50:34.901557 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:34.912008 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:34.922368 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:34.932745 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:34.943105 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:34.953421 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:35.072347 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:35.189763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:35.645931 run create_hlr_db(pid=15012): Launched 23:50:35.769969 bus /sierra_2: Setting Powered False 23:50:36.831992 run create_hlr_db(pid=15012): Terminated: ok {rc=0} 23:50:37.254472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15014): Launched 23:50:37.547102 run osmo-hlr_10.42.42.2(pid=15015): Launched 23:50:37.659071 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:38.162382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15017): Launched 23:50:38.455013 run osmo-stp_10.42.42.5(pid=15018): Launched 23:50:38.576941 tst emergency_mo_mt_call.py: using MSISDN 8393 23:50:38.743368 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:39.271840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15020): Launched 23:50:39.565268 run osmo-msc_10.42.42.6(pid=15021): Launched 23:50:39.729956 run osmo-stp_10.42.42.5(pid=15018): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15018)] 23:50:39.854247 run osmo-stp_10.42.42.5(pid=15018): stdout: | (launched: 2022-12-13_23:50:38.401394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:39.984042 run osmo-stp_10.42.42.5(pid=15018): stderr: | [0;m[38;5;43m20221213235038570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235038570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235038571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235038571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235038571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235038572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235038572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:40.115711 run osmo-stp_10.42.42.5(pid=15018): stdout: | (launched: 2022-12-13_23:50:38.401394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:40.241378 run osmo-stp_10.42.42.5(pid=15018): stderr: | [0;m[38;5;43m20221213235038570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235038570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235038571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235038571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235038571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235038572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235038572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:40.391396 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15018): Process ended prematurely: osmo-stp_10.42.42.5(pid=15018) [trial-2396↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15018)] [trial-2396↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 23:50:40.400341 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 23:50:40.427953 run osmo-hlr_10.42.42.2(pid=15015): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15015)] 23:50:40.478933 run osmo-hlr_10.42.42.2(pid=15015): stdout: | (launched: 2022-12-13_23:50:37.493725) 23:50:40.531192 run osmo-hlr_10.42.42.2(pid=15015): stderr: | [0;m[1;31m20221213235037669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235037669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235037669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235037669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235037669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235037669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235037682 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235037690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235037691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235037691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:40.603497 run osmo-msc_10.42.42.6(pid=15021): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15021)] 23:50:40.653502 run osmo-msc_10.42.42.6(pid=15021): stdout: | (launched: 2022-12-13_23:50:39.511226) 23:50:40.705375 run osmo-msc_10.42.42.6(pid=15021): stderr: | [0;m[38;5;43m20221213235039781 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235039781 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdbafa96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235039781 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235039781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235039782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235039782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235039785 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235039786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235039786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235039786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:40.757523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15014): Terminating (SIGTERM) 23:50:40.799510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15017): Terminating (SIGTERM) 23:50:40.842077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15020): Terminating (SIGTERM) 23:50:40.884311 --- ParallelTerminationStrategy: PID 15014 died... 23:50:40.904619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15014): Terminated: ok {rc=0} 23:50:40.950936 --- ParallelTerminationStrategy: PID 15017 died... 23:50:40.970736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15017): Terminated: ok {rc=0} 23:50:41.016785 --- ParallelTerminationStrategy: PID 15020 died... 23:50:41.037026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15020): Terminated: ok {rc=0} 23:50:41.124368 bus /sierra_3: Setting Powered False 23:50:42.219864 bus /sierra_3: Setting Powered False 23:50:43.331135 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 23:50:44.417320 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:44.429011 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 23:50:44.479594 tst emergency_preemptive_call.py: using LAC 37089 23:50:44.603215 tst emergency_preemptive_call.py: using RAC 114 23:50:44.725244 tst emergency_preemptive_call.py: using CellId 37089 23:50:44.847682 tst emergency_preemptive_call.py: using BVCI 37090 23:50:44.962131 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:44.973257 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:44.984176 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:44.995071 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:45.006697 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:45.018440 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:45.134468 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:45.253150 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:45.366511 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:45.483344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:45.988523 run create_hlr_db(pid=15023): Launched 23:50:46.155209 bus /sierra_2: Setting Powered False 23:50:47.219801 run create_hlr_db(pid=15023): Terminated: ok {rc=0} 23:50:47.645633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15025): Launched 23:50:47.940593 run osmo-hlr_10.42.42.2(pid=15026): Launched 23:50:48.053499 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:48.574058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15028): Launched 23:50:48.867159 run osmo-stp_10.42.42.5(pid=15029): Launched 23:50:48.988647 tst emergency_preemptive_call.py: using MSISDN 8394 23:50:49.139849 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:49.667072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15031): Launched 23:50:49.959580 run osmo-msc_10.42.42.6(pid=15032): Launched 23:50:50.123194 run osmo-stp_10.42.42.5(pid=15029): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15029)] 23:50:50.246697 run osmo-stp_10.42.42.5(pid=15029): stdout: | (launched: 2022-12-13_23:50:48.813422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:50.372225 run osmo-stp_10.42.42.5(pid=15029): stderr: | [0;m[38;5;43m20221213235048982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235048982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235048982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235048983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235048983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235048983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235048983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:50.494954 run osmo-stp_10.42.42.5(pid=15029): stdout: | (launched: 2022-12-13_23:50:48.813422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:50.612164 run osmo-stp_10.42.42.5(pid=15029): stderr: | [0;m[38;5;43m20221213235048982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235048982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235048982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235048983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235048983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235048983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235048983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:50.751535 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15029): Process ended prematurely: osmo-stp_10.42.42.5(pid=15029) [trial-2396↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15029)] [trial-2396↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 23:50:50.760014 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 23:50:50.785920 run osmo-hlr_10.42.42.2(pid=15026): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15026)] 23:50:50.833427 run osmo-hlr_10.42.42.2(pid=15026): stdout: | (launched: 2022-12-13_23:50:47.886776) 23:50:50.882065 run osmo-hlr_10.42.42.2(pid=15026): stderr: | [0;m[1;31m20221213235048065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235048065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235048065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235048065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235048065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235048065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235048077 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235048085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235048086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235048086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:50.950307 run osmo-msc_10.42.42.6(pid=15032): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15032)] 23:50:50.997460 run osmo-msc_10.42.42.6(pid=15032): stdout: | (launched: 2022-12-13_23:50:49.906104) 23:50:51.046370 run osmo-msc_10.42.42.6(pid=15032): stderr: | [0;m[38;5;43m20221213235050176 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235050177 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8da68fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235050177 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235050177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235050177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235050177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235050179 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235050179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235050179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235050180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:51.095303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15025): Terminating (SIGTERM) 23:50:51.134312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15028): Terminating (SIGTERM) 23:50:51.173167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15031): Terminating (SIGTERM) 23:50:51.212273 --- ParallelTerminationStrategy: PID 15025 died... 23:50:51.231302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15025): Terminated: ok {rc=0} 23:50:51.275202 --- ParallelTerminationStrategy: PID 15028 died... 23:50:51.293882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15028): Terminated: ok {rc=0} 23:50:51.337457 --- ParallelTerminationStrategy: PID 15031 died... 23:50:51.355901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15031): Terminated: ok {rc=0} 23:50:51.440387 bus /sierra_9: Setting Powered False 23:50:52.539771 bus /sierra_9: Setting Powered False 23:50:53.651367 bus /sierra_8: Setting Powered False 23:50:54.748896 bus /sierra_8: Setting Powered False 23:50:55.866576 bus /sierra_3: Setting Powered False 23:50:56.963842 bus /sierra_3: Setting Powered False 23:50:58.078370 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-umtrx --------------------------------------------------------------------- 23:50:59.353279 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:50:59.357417 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:50:59.389639 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 23:50:59.427657 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 23:50:59.514808 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:50:59.546708 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 23:50:59.584551 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 23:51:00.173928 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 23:51:00.222860 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:00.233366 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:51:00.280824 tst cs_paging_gprs_active.py: using LAC 37090 23:51:00.400638 tst cs_paging_gprs_active.py: using RAC 115 23:51:00.518306 tst cs_paging_gprs_active.py: using CellId 37090 23:51:00.635907 tst cs_paging_gprs_active.py: using BVCI 37091 23:51:00.746562 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:00.757278 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:00.767569 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:00.777954 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:00.788144 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:00.798407 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:00.808758 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:00.819538 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:00.833476 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:00.969400 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:01.096915 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:51:01.322900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:01.659329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15037): Launched 23:51:01.978326 run iperf3-srv_10.42.42.10(pid=15038): Launched 23:51:02.113131 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:51:02.332428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:02.655665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15039): Launched 23:51:02.934453 run iperf3-srv_10.42.42.10(pid=15040): Launched 23:51:03.054477 tst cs_paging_gprs_active.py:38: start network... 23:51:03.271031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:03.768229 run create_hlr_db(pid=15041): Launched 23:51:03.891413 bus /sierra_2: Setting Powered False 23:51:04.954776 run create_hlr_db(pid=15041): Terminated: ok {rc=0} 23:51:05.402274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15043): Launched 23:51:05.725466 run osmo-hlr_10.42.42.2(pid=15044): Launched 23:51:05.849386 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:06.399374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15046): Launched 23:51:06.720240 run osmo-stp_10.42.42.5(pid=15047): Launched 23:51:06.844268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:07.397052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15049): Launched 23:51:07.520089 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:07.790587 run patchelf(pid=15050): Launched 23:51:07.968339 run osmo-stp_10.42.42.5(pid=15047): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15047)] 23:51:08.104364 run osmo-stp_10.42.42.5(pid=15047): stdout: | (launched: 2022-12-13_23:51:06.662321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:08.242671 run osmo-stp_10.42.42.5(pid=15047): stderr: | [0;m[38;5;43m20221213235106854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235106854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235106855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235106855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235106855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235106856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235106856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:08.380719 run osmo-stp_10.42.42.5(pid=15047): stdout: | (launched: 2022-12-13_23:51:06.662321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:08.512895 run osmo-stp_10.42.42.5(pid=15047): stderr: | [0;m[38;5;43m20221213235106854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235106854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235106855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235106855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235106855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235106856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235106856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:08.669578 run patchelf(pid=15050): Terminating (SIGINT) 23:51:08.849498 run patchelf(pid=15050): Terminated: ok {rc=0} 23:51:08.979329 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15047): Process ended prematurely: osmo-stp_10.42.42.5(pid=15047) [trial-2396↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15047)] [trial-2396↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 23:51:08.989573 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 23:51:09.017958 run osmo-hlr_10.42.42.2(pid=15044): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15044)] 23:51:09.068891 run osmo-hlr_10.42.42.2(pid=15044): stdout: | (launched: 2022-12-13_23:51:05.667060) 23:51:09.121162 run osmo-hlr_10.42.42.2(pid=15044): stderr: | [0;m[1;31m20221213235105865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235105865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235105865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235105865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235105865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235105865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235105877 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235105886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235105886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235105886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:09.173625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15037): Terminating (SIGTERM) 23:51:09.215498 run iperf3-srv_10.42.42.10(pid=15038): Terminating (SIGTERM) 23:51:09.257591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15039): Terminating (SIGTERM) 23:51:09.299893 run iperf3-srv_10.42.42.10(pid=15040): Terminating (SIGTERM) 23:51:09.342047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15043): Terminating (SIGTERM) 23:51:09.384107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15046): Terminating (SIGTERM) 23:51:09.426576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15049): Terminating (SIGTERM) 23:51:09.469088 --- ParallelTerminationStrategy: PID 15037 died... 23:51:09.489672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15037): Terminated: ok {rc=0} 23:51:09.536397 --- ParallelTerminationStrategy: PID 15038 died... 23:51:09.556377 run iperf3-srv_10.42.42.10(pid=15038): Terminated {rc=256} 23:51:09.602373 --- ParallelTerminationStrategy: PID 15039 died... 23:51:09.622372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15039): Terminated: ok {rc=0} 23:51:09.669193 --- ParallelTerminationStrategy: PID 15040 died... 23:51:09.689153 run iperf3-srv_10.42.42.10(pid=15040): Terminated {rc=256} 23:51:09.735016 --- ParallelTerminationStrategy: PID 15043 died... 23:51:09.754943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15043): Terminated: ok {rc=0} 23:51:09.800914 --- ParallelTerminationStrategy: PID 15046 died... 23:51:09.821421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15046): Terminated: ok {rc=0} 23:51:09.867726 --- ParallelTerminationStrategy: PID 15049 died... 23:51:09.887776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15049): Terminated: ok {rc=0} 23:51:09.975455 bus /gobi_0: Setting Powered False 23:51:11.073723 bus /gobi_0: Setting Powered False 23:51:12.189767 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx iperf3.py ---------------------------------------------- 23:51:13.331783 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:13.343492 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:51:13.394101 tst iperf3.py: using LAC 37091 23:51:13.522097 tst iperf3.py: using RAC 116 23:51:13.647702 tst iperf3.py: using CellId 37091 23:51:13.774629 tst iperf3.py: using BVCI 37092 23:51:13.893280 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:13.904439 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:13.915323 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:13.926149 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:13.937234 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:13.948218 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:13.959503 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:13.970609 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:13.981828 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:14.098032 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:51:14.316706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:14.639595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15051): Launched 23:51:14.918098 run iperf3-srv_10.42.42.10(pid=15052): Launched 23:51:15.038580 tst iperf3.py:8: start network... 23:51:15.256538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:15.753348 run create_hlr_db(pid=15053): Launched 23:51:15.876445 bus /gobi_6: Setting Powered False 23:51:16.938749 run create_hlr_db(pid=15053): Terminated: ok {rc=0} 23:51:17.395132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15055): Launched 23:51:17.716212 run osmo-hlr_10.42.42.2(pid=15056): Launched 23:51:17.838818 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:18.370773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15058): Launched 23:51:18.669084 run osmo-stp_10.42.42.5(pid=15059): Launched 23:51:18.782275 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:19.294877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15061): Launched 23:51:19.408061 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:19.660718 run patchelf(pid=15062): Launched 23:51:19.827043 run osmo-stp_10.42.42.5(pid=15059): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15059)] 23:51:19.953184 run osmo-stp_10.42.42.5(pid=15059): stdout: | (launched: 2022-12-13_23:51:18.614143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:20.081372 run osmo-stp_10.42.42.5(pid=15059): stderr: | [0;m[38;5;43m20221213235118784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235118784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235118784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235118785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235118785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235118785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235118785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:20.209609 run osmo-stp_10.42.42.5(pid=15059): stdout: | (launched: 2022-12-13_23:51:18.614143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:20.331810 run osmo-stp_10.42.42.5(pid=15059): stderr: | [0;m[38;5;43m20221213235118784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235118784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235118784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235118785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235118785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235118785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235118785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:20.476723 run patchelf(pid=15062): Terminating (SIGINT) 23:51:20.643927 run patchelf(pid=15062): Terminated: ok {rc=0} 23:51:20.764095 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15059): Process ended prematurely: osmo-stp_10.42.42.5(pid=15059) [trial-2396↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15059)] [trial-2396↪gprs:trx-umtrx↪iperf3.py:8] 23:51:20.773288 tst iperf3.py:8: Test FAILED (7.5 sec) 23:51:20.799887 run osmo-hlr_10.42.42.2(pid=15056): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15056)] 23:51:20.846887 run osmo-hlr_10.42.42.2(pid=15056): stdout: | (launched: 2022-12-13_23:51:17.658099) 23:51:20.895467 run osmo-hlr_10.42.42.2(pid=15056): stderr: | [0;m[1;31m20221213235117856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235117856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235117856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235117856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235117856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235117856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235117868 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235117877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235117877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235117877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:20.944598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15051): Terminating (SIGTERM) 23:51:20.983402 run iperf3-srv_10.42.42.10(pid=15052): Terminating (SIGTERM) 23:51:21.022174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15055): Terminating (SIGTERM) 23:51:21.060925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15058): Terminating (SIGTERM) 23:51:21.099616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15061): Terminating (SIGTERM) 23:51:21.138781 --- ParallelTerminationStrategy: PID 15051 died... 23:51:21.157597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15051): Terminated: ok {rc=0} 23:51:21.201088 --- ParallelTerminationStrategy: PID 15052 died... 23:51:21.219439 run iperf3-srv_10.42.42.10(pid=15052): Terminated {rc=256} 23:51:21.262623 --- ParallelTerminationStrategy: PID 15055 died... 23:51:21.281064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15055): Terminated: ok {rc=0} 23:51:21.324333 --- ParallelTerminationStrategy: PID 15058 died... 23:51:21.342805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15058): Terminated: ok {rc=0} 23:51:21.386031 --- ParallelTerminationStrategy: PID 15061 died... 23:51:21.404441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15061): Terminated: ok {rc=0} 23:51:21.487335 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 23:51:22.629389 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:22.640342 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:51:22.688124 tst iperf3m4.py: using LAC 37092 23:51:22.808016 tst iperf3m4.py: using RAC 117 23:51:22.928385 tst iperf3m4.py: using CellId 37092 23:51:23.057236 tst iperf3m4.py: using BVCI 37093 23:51:23.175729 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:23.187220 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:23.198328 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:23.209337 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:23.220693 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:23.232038 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:23.243346 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:23.254617 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:23.265862 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:23.386030 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:23.509596 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:23.629357 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:23.745664 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:51:23.947896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:24.250013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15063): Launched 23:51:24.511053 run iperf3-srv_10.42.42.10(pid=15064): Launched 23:51:24.622817 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:51:24.823648 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:25.123842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15065): Launched 23:51:25.384731 run iperf3-srv_10.42.42.10(pid=15066): Launched 23:51:25.497100 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:51:25.698945 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:25.999905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15067): Launched 23:51:26.260552 run iperf3-srv_10.42.42.10(pid=15068): Launched 23:51:26.373074 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:51:26.573764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:26.874061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15069): Launched 23:51:27.134950 run iperf3-srv_10.42.42.10(pid=15070): Launched 23:51:27.247069 tst iperf3m4.py:8: start network... 23:51:27.449725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:27.914106 run create_hlr_db(pid=15071): Launched 23:51:28.036917 bus /gobi_6: Setting Powered False 23:51:29.097579 run create_hlr_db(pid=15071): Terminated: ok {rc=0} 23:51:29.515818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15073): Launched 23:51:29.816343 run osmo-hlr_10.42.42.2(pid=15077): Launched 23:51:29.930395 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:30.449909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15079): Launched 23:51:30.748787 run osmo-stp_10.42.42.5(pid=15080): Launched 23:51:30.915894 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:31.622448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15082): Launched 23:51:31.758968 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:32.044400 run patchelf(pid=15083): Launched 23:51:32.240849 run osmo-stp_10.42.42.5(pid=15080): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15080)] 23:51:32.378325 run osmo-stp_10.42.42.5(pid=15080): stdout: | (launched: 2022-12-13_23:51:30.693932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:32.517028 run osmo-stp_10.42.42.5(pid=15080): stderr: | [0;m[38;5;43m20221213235130894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235130895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235130895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235130895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235130896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235130896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235130896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:32.655405 run osmo-stp_10.42.42.5(pid=15080): stdout: | (launched: 2022-12-13_23:51:30.693932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:32.787333 run osmo-stp_10.42.42.5(pid=15080): stderr: | [0;m[38;5;43m20221213235130894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235130895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235130895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235130895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235130896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235130896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235130896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:32.943642 run patchelf(pid=15083): Terminating (SIGINT) 23:51:33.124317 run patchelf(pid=15083): Terminated: ok {rc=0} 23:51:33.254658 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15080): Process ended prematurely: osmo-stp_10.42.42.5(pid=15080) [trial-2396↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15080)] [trial-2396↪gprs:trx-umtrx↪iperf3m4.py:8] 23:51:33.264854 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:51:33.293701 run osmo-hlr_10.42.42.2(pid=15077): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15077)] 23:51:33.344857 run osmo-hlr_10.42.42.2(pid=15077): stdout: | (launched: 2022-12-13_23:51:29.761154) 23:51:33.397081 run osmo-hlr_10.42.42.2(pid=15077): stderr: | [0;m[1;31m20221213235129938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235129938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235129938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235129938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235129938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235129938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235129950 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235129958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235129959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235129959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:33.449906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15063): Terminating (SIGTERM) 23:51:33.491721 run iperf3-srv_10.42.42.10(pid=15064): Terminating (SIGTERM) 23:51:33.533772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15065): Terminating (SIGTERM) 23:51:33.575830 run iperf3-srv_10.42.42.10(pid=15066): Terminating (SIGTERM) 23:51:33.617852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15067): Terminating (SIGTERM) 23:51:33.660099 run iperf3-srv_10.42.42.10(pid=15068): Terminating (SIGTERM) 23:51:33.702099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15069): Terminating (SIGTERM) 23:51:33.744184 run iperf3-srv_10.42.42.10(pid=15070): Terminating (SIGTERM) 23:51:33.786056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15073): Terminating (SIGTERM) 23:51:33.827990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15079): Terminating (SIGTERM) 23:51:33.869831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15082): Terminating (SIGTERM) 23:51:33.912016 --- ParallelTerminationStrategy: PID 15063 died... 23:51:33.932380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15063): Terminated: ok {rc=0} 23:51:33.978858 --- ParallelTerminationStrategy: PID 15064 died... 23:51:33.998662 run iperf3-srv_10.42.42.10(pid=15064): Terminated {rc=256} 23:51:34.044877 --- ParallelTerminationStrategy: PID 15065 died... 23:51:34.065177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15065): Terminated: ok {rc=0} 23:51:34.111606 --- ParallelTerminationStrategy: PID 15066 died... 23:51:34.131517 run iperf3-srv_10.42.42.10(pid=15066): Terminated {rc=256} 23:51:34.177812 --- ParallelTerminationStrategy: PID 15067 died... 23:51:34.197640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15067): Terminated: ok {rc=0} 23:51:34.243938 --- ParallelTerminationStrategy: PID 15068 died... 23:51:34.263793 run iperf3-srv_10.42.42.10(pid=15068): Terminated {rc=256} 23:51:34.310170 --- ParallelTerminationStrategy: PID 15069 died... 23:51:34.330131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15069): Terminated: ok {rc=0} 23:51:34.376573 --- ParallelTerminationStrategy: PID 15070 died... 23:51:34.396450 run iperf3-srv_10.42.42.10(pid=15070): Terminated {rc=256} 23:51:34.443274 --- ParallelTerminationStrategy: PID 15073 died... 23:51:34.463276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15073): Terminated: ok {rc=0} 23:51:34.509833 --- ParallelTerminationStrategy: PID 15079 died... 23:51:34.529956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15079): Terminated: ok {rc=0} 23:51:34.576513 --- ParallelTerminationStrategy: PID 15082 died... 23:51:34.596541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15082): Terminated: ok {rc=0} 23:51:34.685370 bus /gobi_4: Setting Powered False 23:51:35.783925 bus /gobi_4: Setting Powered False 23:51:36.899232 bus /gobi_1: Setting Powered False 23:51:37.997154 bus /gobi_1: Setting Powered False 23:51:39.113171 bus /gobi_0: Setting Powered False 23:51:40.210070 bus /gobi_0: Setting Powered False 23:51:41.326182 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx ping.py ---------------------------------------------- 23:51:42.428068 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:42.439909 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:51:42.492121 tst ping.py: using LAC 37093 23:51:42.608415 tst ping.py: using RAC 118 23:51:42.722969 tst ping.py: using CellId 37093 23:51:42.836506 tst ping.py: using BVCI 37094 23:51:42.943423 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:42.953980 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:42.964265 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:42.974628 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:42.984830 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:42.995089 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:43.005468 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:43.015799 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:43.126806 tst ping.py:19: start network... 23:51:43.323366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:43.778394 run create_hlr_db(pid=15084): Launched 23:51:43.898110 bus /gobi_6: Setting Powered False 23:51:44.956712 run create_hlr_db(pid=15084): Terminated: ok {rc=0} 23:51:45.386186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15086): Launched 23:51:45.699889 run osmo-hlr_10.42.42.2(pid=15087): Launched 23:51:45.819991 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:46.525691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15089): Launched 23:51:46.859465 run osmo-stp_10.42.42.5(pid=15090): Launched 23:51:47.073524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:47.656714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15092): Launched 23:51:47.777498 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:48.043734 run patchelf(pid=15094): Launched 23:51:48.218871 run osmo-stp_10.42.42.5(pid=15090): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15090)] 23:51:48.352106 run osmo-stp_10.42.42.5(pid=15090): stdout: | (launched: 2022-12-13_23:51:46.795207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:48.487735 run osmo-stp_10.42.42.5(pid=15090): stderr: | [0;m[38;5;43m20221213235147155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235147155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235147155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235147155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235147156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235147156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235147156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:48.622790 run osmo-stp_10.42.42.5(pid=15090): stdout: | (launched: 2022-12-13_23:51:46.795207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:48.752527 run osmo-stp_10.42.42.5(pid=15090): stderr: | [0;m[38;5;43m20221213235147155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235147155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235147155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235147155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235147156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235147156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235147156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:48.906102 run patchelf(pid=15094): Terminating (SIGINT) 23:51:49.082110 run patchelf(pid=15094): Terminated: ok {rc=0} 23:51:49.208938 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15090): Process ended prematurely: osmo-stp_10.42.42.5(pid=15090) [trial-2396↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15090)] [trial-2396↪gprs:trx-umtrx↪ping.py:22] 23:51:49.218397 tst ping.py:22: Test FAILED (6.8 sec) 23:51:49.246170 run osmo-hlr_10.42.42.2(pid=15087): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15087)] 23:51:49.296320 run osmo-hlr_10.42.42.2(pid=15087): stdout: | (launched: 2022-12-13_23:51:45.643113) 23:51:49.347800 run osmo-hlr_10.42.42.2(pid=15087): stderr: | [0;m[1;31m20221213235145866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235145866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235145866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235145866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235145866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235145866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235145881 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235145901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235145901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235145901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:49.400094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15086): Terminating (SIGTERM) 23:51:49.441433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15089): Terminating (SIGTERM) 23:51:49.483657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15092): Terminating (SIGTERM) 23:51:49.525281 --- ParallelTerminationStrategy: PID 15086 died... 23:51:49.545715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15086): Terminated: ok {rc=0} 23:51:49.591878 --- ParallelTerminationStrategy: PID 15089 died... 23:51:49.611687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15089): Terminated: ok {rc=0} 23:51:49.657677 --- ParallelTerminationStrategy: PID 15092 died... 23:51:49.677353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15092): Terminated: ok {rc=0} 23:51:49.764171 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 23:51:50.850508 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:50.862387 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:51:50.913387 tst ping_idle_ping.py: using LAC 37094 23:51:51.037210 tst ping_idle_ping.py: using RAC 119 23:51:51.160696 tst ping_idle_ping.py: using CellId 37094 23:51:51.284078 tst ping_idle_ping.py: using BVCI 37095 23:51:51.400112 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:51.411107 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:51.422020 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:51.432726 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:51.444271 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:51.455394 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:51.466717 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:51.477997 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:51.596728 tst ping_idle_ping.py:24: start network... 23:51:51.810259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:52.300566 run create_hlr_db(pid=15095): Launched 23:51:52.421016 bus /gobi_6: Setting Powered False 23:51:53.484546 run create_hlr_db(pid=15095): Terminated: ok {rc=0} 23:51:53.909652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15097): Launched 23:51:54.205643 run osmo-hlr_10.42.42.2(pid=15098): Launched 23:51:54.318464 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:54.826391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15100): Launched 23:51:55.120215 run osmo-stp_10.42.42.5(pid=15101): Launched 23:51:55.232326 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:55.740776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15103): Launched 23:51:55.854144 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:56.102516 run patchelf(pid=15104): Launched 23:51:56.265635 run osmo-stp_10.42.42.5(pid=15101): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15101)] 23:51:56.390332 run osmo-stp_10.42.42.5(pid=15101): stdout: | (launched: 2022-12-13_23:51:55.066314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:56.516785 run osmo-stp_10.42.42.5(pid=15101): stderr: | [0;m[38;5;43m20221213235155235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235155235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235155236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235155236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235155237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235155237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235155237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:56.643529 run osmo-stp_10.42.42.5(pid=15101): stdout: | (launched: 2022-12-13_23:51:55.066314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:56.764548 run osmo-stp_10.42.42.5(pid=15101): stderr: | [0;m[38;5;43m20221213235155235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235155235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235155236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235155236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235155237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235155237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235155237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:56.907907 run patchelf(pid=15104): Terminating (SIGINT) 23:51:57.073260 run patchelf(pid=15104): Terminated: ok {rc=0} 23:51:57.191808 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15101): Process ended prematurely: osmo-stp_10.42.42.5(pid=15101) [trial-2396↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15101)] [trial-2396↪gprs:trx-umtrx↪ping_idle_ping.py:27] 23:51:57.200655 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 23:51:57.227378 run osmo-hlr_10.42.42.2(pid=15098): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15098)] 23:51:57.274736 run osmo-hlr_10.42.42.2(pid=15098): stdout: | (launched: 2022-12-13_23:51:54.151252) 23:51:57.324051 run osmo-hlr_10.42.42.2(pid=15098): stderr: | [0;m[1;31m20221213235154327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235154327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235154327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235154327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235154327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235154328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235154346 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235154354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235154355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235154355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:57.373825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15097): Terminating (SIGTERM) 23:51:57.413530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15100): Terminating (SIGTERM) 23:51:57.453237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15103): Terminating (SIGTERM) 23:51:57.493866 --- ParallelTerminationStrategy: PID 15097 died... 23:51:57.512911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15097): Terminated: ok {rc=0} 23:51:57.557054 --- ParallelTerminationStrategy: PID 15100 died... 23:51:57.575615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15100): Terminated: ok {rc=0} 23:51:57.619328 --- ParallelTerminationStrategy: PID 15103 died... 23:51:57.637862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15103): Terminated: ok {rc=0} 23:51:57.723674 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 23:51:59.026581 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:51:59.032086 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:51:59.063811 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:51:59.101902 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:51:59.187549 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:51:59.219511 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:51:59.257934 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:51:59.850177 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:51:59.898444 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:59.909252 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:51:59.958871 tst cs_paging_gprs_active.py: using LAC 37095 23:52:00.080316 tst cs_paging_gprs_active.py: using RAC 120 23:52:00.208262 tst cs_paging_gprs_active.py: using CellId 37095 23:52:00.338213 tst cs_paging_gprs_active.py: using BVCI 37096 23:52:00.457269 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:00.468714 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:00.479956 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:00.491127 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:00.502726 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:00.514257 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:00.526100 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:00.537381 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:00.549145 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:00.667080 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:00.782235 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:52:01.000262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:01.314167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15108): Launched 23:52:01.629781 run iperf3-srv_10.42.42.10(pid=15109): Launched 23:52:01.767578 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:52:01.995140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:02.327972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15110): Launched 23:52:02.608745 run iperf3-srv_10.42.42.10(pid=15111): Launched 23:52:02.729740 tst cs_paging_gprs_active.py:38: start network... 23:52:02.947887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:03.448007 run create_hlr_db(pid=15112): Launched 23:52:03.570691 bus /gobi_6: Setting Powered False 23:52:04.634882 run create_hlr_db(pid=15112): Terminated: ok {rc=0} 23:52:05.066345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15114): Launched 23:52:05.367285 run osmo-hlr_10.42.42.2(pid=15115): Launched 23:52:05.482623 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:06.001254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15117): Launched 23:52:06.302210 run osmo-stp_10.42.42.5(pid=15118): Launched 23:52:06.416888 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:06.935129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15120): Launched 23:52:07.050019 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:07.304138 run patchelf(pid=15121): Launched 23:52:07.471042 run osmo-stp_10.42.42.5(pid=15118): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15118)] 23:52:07.598076 run osmo-stp_10.42.42.5(pid=15118): stdout: | (launched: 2022-12-13_23:52:06.247536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:07.727349 run osmo-stp_10.42.42.5(pid=15118): stderr: | [0;m[38;5;43m20221213235206416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235206416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235206417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235206417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235206418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235206418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235206418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:07.856125 run osmo-stp_10.42.42.5(pid=15118): stdout: | (launched: 2022-12-13_23:52:06.247536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:07.979854 run osmo-stp_10.42.42.5(pid=15118): stderr: | [0;m[38;5;43m20221213235206416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235206416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235206417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235206417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235206418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235206418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235206418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:08.125515 run patchelf(pid=15121): Terminating (SIGINT) 23:52:08.294459 run patchelf(pid=15121): Terminated: ok {rc=0} 23:52:08.415928 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15118): Process ended prematurely: osmo-stp_10.42.42.5(pid=15118) [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15118)] [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:52:08.425264 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 23:52:08.452344 run osmo-hlr_10.42.42.2(pid=15115): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15115)] 23:52:08.499819 run osmo-hlr_10.42.42.2(pid=15115): stdout: | (launched: 2022-12-13_23:52:05.312253) 23:52:08.548839 run osmo-hlr_10.42.42.2(pid=15115): stderr: | [0;m[1;31m20221213235205490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235205490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235205490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235205490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235205490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235205491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235205506 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235205514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235205515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235205515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:08.598464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15108): Terminating (SIGTERM) 23:52:08.637889 run iperf3-srv_10.42.42.10(pid=15109): Terminating (SIGTERM) 23:52:08.677113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15110): Terminating (SIGTERM) 23:52:08.716241 run iperf3-srv_10.42.42.10(pid=15111): Terminating (SIGTERM) 23:52:08.755294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15114): Terminating (SIGTERM) 23:52:08.794817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15117): Terminating (SIGTERM) 23:52:08.833957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15120): Terminating (SIGTERM) 23:52:08.873463 --- ParallelTerminationStrategy: PID 15108 died... 23:52:08.892471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15108): Terminated: ok {rc=0} 23:52:08.936002 --- ParallelTerminationStrategy: PID 15109 died... 23:52:08.954424 run iperf3-srv_10.42.42.10(pid=15109): Terminated {rc=256} 23:52:08.997922 --- ParallelTerminationStrategy: PID 15110 died... 23:52:09.016415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15110): Terminated: ok {rc=0} 23:52:09.059744 --- ParallelTerminationStrategy: PID 15111 died... 23:52:09.078161 run iperf3-srv_10.42.42.10(pid=15111): Terminated {rc=256} 23:52:09.121430 --- ParallelTerminationStrategy: PID 15114 died... 23:52:09.139983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15114): Terminated: ok {rc=0} 23:52:09.183365 --- ParallelTerminationStrategy: PID 15117 died... 23:52:09.201846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15117): Terminated: ok {rc=0} 23:52:09.245068 --- ParallelTerminationStrategy: PID 15120 died... 23:52:09.263539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15120): Terminated: ok {rc=0} 23:52:09.348000 bus /gobi_0: Setting Powered False 23:52:10.446455 bus /gobi_0: Setting Powered False 23:52:11.560025 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:52:12.709108 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:12.720349 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:52:12.772240 tst iperf3.py: using LAC 37096 23:52:12.897168 tst iperf3.py: using RAC 121 23:52:13.014736 tst iperf3.py: using CellId 37096 23:52:13.133347 tst iperf3.py: using BVCI 37097 23:52:13.252213 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:13.263819 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:13.275039 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:13.286414 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:13.298047 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:13.309531 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:13.321111 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:13.332409 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:13.344033 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:13.458930 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:52:13.661227 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:13.963526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15122): Launched 23:52:14.224925 run iperf3-srv_10.42.42.10(pid=15123): Launched 23:52:14.337723 tst iperf3.py:8: start network... 23:52:14.539731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:15.003448 run create_hlr_db(pid=15124): Launched 23:52:15.126939 bus /gobi_6: Setting Powered False 23:52:16.189415 run create_hlr_db(pid=15124): Terminated: ok {rc=0} 23:52:16.648627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15126): Launched 23:52:16.990377 run osmo-hlr_10.42.42.2(pid=15127): Launched 23:52:17.130866 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:17.711558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15129): Launched 23:52:18.032783 run osmo-stp_10.42.42.5(pid=15130): Launched 23:52:18.156064 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:18.710162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15132): Launched 23:52:18.832661 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:19.103367 run patchelf(pid=15133): Launched 23:52:19.282388 run osmo-stp_10.42.42.5(pid=15130): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15130)] 23:52:19.418125 run osmo-stp_10.42.42.5(pid=15130): stdout: | (launched: 2022-12-13_23:52:17.974356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:19.555979 run osmo-stp_10.42.42.5(pid=15130): stderr: | [0;m[38;5;43m20221213235218167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235218167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235218167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235218168 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235218168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235218168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235218169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:19.693595 run osmo-stp_10.42.42.5(pid=15130): stdout: | (launched: 2022-12-13_23:52:17.974356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:19.825148 run osmo-stp_10.42.42.5(pid=15130): stderr: | [0;m[38;5;43m20221213235218167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235218167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235218167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235218168 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235218168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235218168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235218169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:19.980493 run patchelf(pid=15133): Terminating (SIGINT) 23:52:20.160371 run patchelf(pid=15133): Terminated: ok {rc=0} 23:52:20.289766 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15130): Process ended prematurely: osmo-stp_10.42.42.5(pid=15130) [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15130)] [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 23:52:20.299866 tst iperf3.py:8: Test FAILED (7.6 sec) 23:52:20.328263 run osmo-hlr_10.42.42.2(pid=15127): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15127)] 23:52:20.378340 run osmo-hlr_10.42.42.2(pid=15127): stdout: | (launched: 2022-12-13_23:52:16.926518) 23:52:20.429906 run osmo-hlr_10.42.42.2(pid=15127): stderr: | [0;m[1;31m20221213235217222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235217222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235217222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235217222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235217222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235217222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235217235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235217243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235217243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235217244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:20.482373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15122): Terminating (SIGTERM) 23:52:20.524059 run iperf3-srv_10.42.42.10(pid=15123): Terminating (SIGTERM) 23:52:20.565677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15126): Terminating (SIGTERM) 23:52:20.607212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15129): Terminating (SIGTERM) 23:52:20.648768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15132): Terminating (SIGTERM) 23:52:20.690626 --- ParallelTerminationStrategy: PID 15122 died... 23:52:20.711075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15122): Terminated: ok {rc=0} 23:52:20.757175 --- ParallelTerminationStrategy: PID 15123 died... 23:52:20.777045 run iperf3-srv_10.42.42.10(pid=15123): Terminated {rc=256} 23:52:20.822771 --- ParallelTerminationStrategy: PID 15126 died... 23:52:20.842611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15126): Terminated: ok {rc=0} 23:52:20.888198 --- ParallelTerminationStrategy: PID 15129 died... 23:52:20.907877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15129): Terminated: ok {rc=0} 23:52:20.953821 --- ParallelTerminationStrategy: PID 15132 died... 23:52:20.973545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15132): Terminated: ok {rc=0} 23:52:21.060929 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:52:22.206014 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:22.217521 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:52:22.270637 tst iperf3m4.py: using LAC 37097 23:52:22.398989 tst iperf3m4.py: using RAC 122 23:52:22.525222 tst iperf3m4.py: using CellId 37097 23:52:22.649036 tst iperf3m4.py: using BVCI 37098 23:52:22.765431 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:22.776692 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:22.787947 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:22.798908 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:22.810308 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:22.821739 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:22.833255 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:22.844420 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:22.855967 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:22.973587 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:23.096035 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:23.214105 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:23.329172 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:52:23.531640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:23.833146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15134): Launched 23:52:24.094542 run iperf3-srv_10.42.42.10(pid=15135): Launched 23:52:24.206960 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:52:24.407787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:24.709159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15136): Launched 23:52:24.969355 run iperf3-srv_10.42.42.10(pid=15137): Launched 23:52:25.082214 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:52:25.283448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:25.585150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15138): Launched 23:52:25.846261 run iperf3-srv_10.42.42.10(pid=15139): Launched 23:52:25.958646 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:52:26.160834 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:26.462868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15140): Launched 23:52:26.724242 run iperf3-srv_10.42.42.10(pid=15141): Launched 23:52:26.836417 tst iperf3m4.py:8: start network... 23:52:27.037405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:27.502214 run create_hlr_db(pid=15142): Launched 23:52:27.625238 bus /gobi_6: Setting Powered False 23:52:28.685769 run create_hlr_db(pid=15142): Terminated: ok {rc=0} 23:52:29.125305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15144): Launched 23:52:29.445813 run osmo-hlr_10.42.42.2(pid=15145): Launched 23:52:29.569594 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:30.128052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15147): Launched 23:52:30.449909 run osmo-stp_10.42.42.5(pid=15148): Launched 23:52:30.574137 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:31.157839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15150): Launched 23:52:31.286329 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:31.570143 run patchelf(pid=15151): Launched 23:52:31.754765 run osmo-stp_10.42.42.5(pid=15148): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15148)] 23:52:31.886357 run osmo-stp_10.42.42.5(pid=15148): stdout: | (launched: 2022-12-13_23:52:30.391323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:32.018094 run osmo-stp_10.42.42.5(pid=15148): stderr: | [0;m[38;5;43m20221213235230583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235230583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235230583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235230584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235230584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235230584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235230584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:32.150896 run osmo-stp_10.42.42.5(pid=15148): stdout: | (launched: 2022-12-13_23:52:30.391323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:32.275012 run osmo-stp_10.42.42.5(pid=15148): stderr: | [0;m[38;5;43m20221213235230583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235230583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235230583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235230584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235230584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235230584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235230584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:32.420756 run patchelf(pid=15151): Terminating (SIGINT) 23:52:32.590508 run patchelf(pid=15151): Terminated: ok {rc=0} 23:52:32.712522 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15148): Process ended prematurely: osmo-stp_10.42.42.5(pid=15148) [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15148)] [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 23:52:32.721895 tst iperf3m4.py:8: Test FAILED (10.6 sec) 23:52:32.749333 run osmo-hlr_10.42.42.2(pid=15145): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15145)] 23:52:32.797332 run osmo-hlr_10.42.42.2(pid=15145): stdout: | (launched: 2022-12-13_23:52:29.387756) 23:52:32.847501 run osmo-hlr_10.42.42.2(pid=15145): stderr: | [0;m[1;31m20221213235229586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235229586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235229586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235229587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235229587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235229587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235229599 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235229607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235229608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235229608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:32.897661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15134): Terminating (SIGTERM) 23:52:32.937458 run iperf3-srv_10.42.42.10(pid=15135): Terminating (SIGTERM) 23:52:32.977270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15136): Terminating (SIGTERM) 23:52:33.017576 run iperf3-srv_10.42.42.10(pid=15137): Terminating (SIGTERM) 23:52:33.057229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15138): Terminating (SIGTERM) 23:52:33.097591 run iperf3-srv_10.42.42.10(pid=15139): Terminating (SIGTERM) 23:52:33.137246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15140): Terminating (SIGTERM) 23:52:33.177517 run iperf3-srv_10.42.42.10(pid=15141): Terminating (SIGTERM) 23:52:33.217231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15144): Terminating (SIGTERM) 23:52:33.257207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15147): Terminating (SIGTERM) 23:52:33.296816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15150): Terminating (SIGTERM) 23:52:33.336766 --- ParallelTerminationStrategy: PID 15134 died... 23:52:33.355681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15134): Terminated: ok {rc=0} 23:52:33.399691 --- ParallelTerminationStrategy: PID 15135 died... 23:52:33.418293 run iperf3-srv_10.42.42.10(pid=15135): Terminated {rc=256} 23:52:33.462008 --- ParallelTerminationStrategy: PID 15136 died... 23:52:33.480835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15136): Terminated: ok {rc=0} 23:52:33.524498 --- ParallelTerminationStrategy: PID 15137 died... 23:52:33.542994 run iperf3-srv_10.42.42.10(pid=15137): Terminated {rc=256} 23:52:33.586655 --- ParallelTerminationStrategy: PID 15138 died... 23:52:33.605303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15138): Terminated: ok {rc=0} 23:52:33.649103 --- ParallelTerminationStrategy: PID 15139 died... 23:52:33.668023 run iperf3-srv_10.42.42.10(pid=15139): Terminated {rc=256} 23:52:33.711570 --- ParallelTerminationStrategy: PID 15140 died... 23:52:33.730463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15140): Terminated: ok {rc=0} 23:52:33.774280 --- ParallelTerminationStrategy: PID 15141 died... 23:52:33.792992 run iperf3-srv_10.42.42.10(pid=15141): Terminated {rc=256} 23:52:33.837649 --- ParallelTerminationStrategy: PID 15144 died... 23:52:33.857285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15144): Terminated: ok {rc=0} 23:52:33.901368 --- ParallelTerminationStrategy: PID 15147 died... 23:52:33.919978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15147): Terminated: ok {rc=0} 23:52:33.964395 --- ParallelTerminationStrategy: PID 15150 died... 23:52:33.983371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15150): Terminated: ok {rc=0} 23:52:34.068533 bus /gobi_4: Setting Powered False 23:52:35.166587 bus /gobi_4: Setting Powered False 23:52:36.282075 bus /gobi_1: Setting Powered False 23:52:37.380204 bus /gobi_1: Setting Powered False 23:52:38.495735 bus /gobi_0: Setting Powered False 23:52:39.592566 bus /gobi_0: Setting Powered False 23:52:40.708305 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 23:52:41.809926 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:41.822013 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:52:41.873368 tst ping.py: using LAC 37098 23:52:42.001249 tst ping.py: using RAC 123 23:52:42.118039 tst ping.py: using CellId 37098 23:52:42.234278 tst ping.py: using BVCI 37099 23:52:42.340738 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:42.351679 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:42.362838 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:42.373418 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:42.384212 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:42.395403 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:42.406792 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:42.417996 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:42.536624 tst ping.py:19: start network... 23:52:42.748597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:43.234487 run create_hlr_db(pid=15152): Launched 23:52:43.354792 bus /gobi_6: Setting Powered False 23:52:44.414090 run create_hlr_db(pid=15152): Terminated: ok {rc=0} 23:52:44.853726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15154): Launched 23:52:45.168003 run osmo-hlr_10.42.42.2(pid=15155): Launched 23:52:45.288169 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:45.850367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15157): Launched 23:52:46.197687 run osmo-stp_10.42.42.5(pid=15158): Launched 23:52:46.456460 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:47.111300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15160): Launched 23:52:47.232377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:47.482786 run patchelf(pid=15161): Launched 23:52:47.646707 run osmo-stp_10.42.42.5(pid=15158): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15158)] 23:52:47.771856 run osmo-stp_10.42.42.5(pid=15158): stdout: | (launched: 2022-12-13_23:52:46.129485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:47.898604 run osmo-stp_10.42.42.5(pid=15158): stderr: | [0;m[38;5;43m20221213235246419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235246419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235246419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235246419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235246422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235246422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235246422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:48.025104 run osmo-stp_10.42.42.5(pid=15158): stdout: | (launched: 2022-12-13_23:52:46.129485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:48.146154 run osmo-stp_10.42.42.5(pid=15158): stderr: | [0;m[38;5;43m20221213235246419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235246419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235246419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235246419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235246422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235246422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235246422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:48.289689 run patchelf(pid=15161): Terminating (SIGINT) 23:52:48.454823 run patchelf(pid=15161): Terminated: ok {rc=0} 23:52:48.574280 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15158): Process ended prematurely: osmo-stp_10.42.42.5(pid=15158) [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15158)] [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 23:52:48.583192 tst ping.py:22: Test FAILED (6.8 sec) 23:52:48.609990 run osmo-hlr_10.42.42.2(pid=15155): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15155)] 23:52:48.658242 run osmo-hlr_10.42.42.2(pid=15155): stdout: | (launched: 2022-12-13_23:52:45.110754) 23:52:48.707644 run osmo-hlr_10.42.42.2(pid=15155): stderr: | [0;m[1;31m20221213235245307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235245307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235245308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235245308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235245308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235245308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235245320 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235245329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235245329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235245329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:48.757521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15154): Terminating (SIGTERM) 23:52:48.797383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15157): Terminating (SIGTERM) 23:52:48.837371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15160): Terminating (SIGTERM) 23:52:48.877752 --- ParallelTerminationStrategy: PID 15154 died... 23:52:48.897209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15154): Terminated: ok {rc=0} 23:52:48.941391 --- ParallelTerminationStrategy: PID 15157 died... 23:52:48.960119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15157): Terminated: ok {rc=0} 23:52:49.004386 --- ParallelTerminationStrategy: PID 15160 died... 23:52:49.023338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15160): Terminated: ok {rc=0} 23:52:49.109442 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:52:50.196854 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.208551 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:52:50.259773 tst ping_idle_ping.py: using LAC 37099 23:52:50.377728 tst ping_idle_ping.py: using RAC 124 23:52:50.496277 tst ping_idle_ping.py: using CellId 37099 23:52:50.613393 tst ping_idle_ping.py: using BVCI 37100 23:52:50.720008 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.731033 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.741742 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.752223 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.762744 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.773228 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.783840 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.794496 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:50.908689 tst ping_idle_ping.py:24: start network... 23:52:51.107319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:51.566528 run create_hlr_db(pid=15162): Launched 23:52:51.687814 bus /gobi_6: Setting Powered False 23:52:52.748361 run create_hlr_db(pid=15162): Terminated: ok {rc=0} 23:52:53.182642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15164): Launched 23:52:53.499636 run osmo-hlr_10.42.42.2(pid=15165): Launched 23:52:53.622140 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:54.174121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15167): Launched 23:52:54.491270 run osmo-stp_10.42.42.5(pid=15168): Launched 23:52:54.612847 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:55.158238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15170): Launched 23:52:55.278656 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:55.546084 run patchelf(pid=15171): Launched 23:52:55.721744 run osmo-stp_10.42.42.5(pid=15168): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15168)] 23:52:55.855636 run osmo-stp_10.42.42.5(pid=15168): stdout: | (launched: 2022-12-13_23:52:54.433426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:55.990922 run osmo-stp_10.42.42.5(pid=15168): stderr: | [0;m[38;5;43m20221213235254623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235254623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235254623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235254624 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235254624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235254624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235254624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:56.126451 run osmo-stp_10.42.42.5(pid=15168): stdout: | (launched: 2022-12-13_23:52:54.433426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:56.256467 run osmo-stp_10.42.42.5(pid=15168): stderr: | [0;m[38;5;43m20221213235254623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235254623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235254623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235254624 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235254624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235254624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235254624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:56.410874 run patchelf(pid=15171): Terminating (SIGINT) 23:52:56.589166 run patchelf(pid=15171): Terminated: ok {rc=0} 23:52:56.716641 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15168): Process ended prematurely: osmo-stp_10.42.42.5(pid=15168) [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15168)] [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 23:52:56.726267 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:52:56.754122 run osmo-hlr_10.42.42.2(pid=15165): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15165)] 23:52:56.804741 run osmo-hlr_10.42.42.2(pid=15165): stdout: | (launched: 2022-12-13_23:52:53.441789) 23:52:56.856585 run osmo-hlr_10.42.42.2(pid=15165): stderr: | [0;m[1;31m20221213235253641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235253641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235253641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235253641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235253641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235253641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235253653 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235253663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235253663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235253663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:56.909415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15164): Terminating (SIGTERM) 23:52:56.951023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15167): Terminating (SIGTERM) 23:52:56.993092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15170): Terminating (SIGTERM) 23:52:57.035174 --- ParallelTerminationStrategy: PID 15164 died... 23:52:57.055765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15164): Terminated: ok {rc=0} 23:52:57.102251 --- ParallelTerminationStrategy: PID 15167 died... 23:52:57.121991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15167): Terminated: ok {rc=0} 23:52:57.168339 --- ParallelTerminationStrategy: PID 15170 died... 23:52:57.188349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15170): Terminated: ok {rc=0} 23:52:57.276117 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:52:58.573849 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:52:58.580241 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:52:58.612584 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:52:58.651475 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:52:58.738617 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:52:58.771004 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:52:58.809090 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:52:59.402074 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:52:59.451439 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:59.462461 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:52:59.531422 tst cs_paging_gprs_active.py: using LAC 37100 23:52:59.649358 tst cs_paging_gprs_active.py: using RAC 125 23:52:59.770927 tst cs_paging_gprs_active.py: using CellId 37100 23:52:59.890085 tst cs_paging_gprs_active.py: using BVCI 37101 23:52:59.999262 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:00.010076 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:00.020720 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:00.031351 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:00.042051 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:00.052613 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:00.063986 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:00.075015 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:00.086070 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:00.207221 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:00.329451 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:53:00.548086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:00.903620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15175): Launched 23:53:01.229828 run iperf3-srv_10.42.42.10(pid=15176): Launched 23:53:01.357894 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:53:01.580901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:01.924549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15177): Launched 23:53:02.212468 run iperf3-srv_10.42.42.10(pid=15178): Launched 23:53:02.334018 tst cs_paging_gprs_active.py:38: start network... 23:53:02.553197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:53:03.052082 run create_hlr_db(pid=15179): Launched 23:53:03.175256 bus /gobi_6: Setting Powered False 23:53:04.238889 run create_hlr_db(pid=15179): Terminated: ok {rc=0} 23:53:04.671503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15181): Launched 23:53:04.994827 run osmo-hlr_10.42.42.2(pid=15182): Launched 23:53:05.118527 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:05.674863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15184): Launched 23:53:05.997586 run osmo-stp_10.42.42.5(pid=15185): Launched 23:53:06.121338 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:06.678498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15187): Launched 23:53:06.802614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:07.082475 run patchelf(pid=15188): Launched 23:53:07.262749 run osmo-stp_10.42.42.5(pid=15185): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15185)] 23:53:07.399636 run osmo-stp_10.42.42.5(pid=15185): stdout: | (launched: 2022-12-13_23:53:05.939038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:07.539288 run osmo-stp_10.42.42.5(pid=15185): stderr: | [0;m[38;5;43m20221213235306132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235306132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235306132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235306133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235306133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235306133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235306133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:07.678139 run osmo-stp_10.42.42.5(pid=15185): stdout: | (launched: 2022-12-13_23:53:05.939038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:07.810918 run osmo-stp_10.42.42.5(pid=15185): stderr: | [0;m[38;5;43m20221213235306132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235306132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235306132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235306133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235306133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235306133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235306133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:07.967659 run patchelf(pid=15188): Terminating (SIGINT) 23:53:08.148496 run patchelf(pid=15188): Terminated: ok {rc=0} 23:53:08.278839 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15185): Process ended prematurely: osmo-stp_10.42.42.5(pid=15185) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15185)] [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:53:08.288783 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 23:53:08.317204 run osmo-hlr_10.42.42.2(pid=15182): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15182)] 23:53:08.367839 run osmo-hlr_10.42.42.2(pid=15182): stdout: | (launched: 2022-12-13_23:53:04.936525) 23:53:08.419972 run osmo-hlr_10.42.42.2(pid=15182): stderr: | [0;m[1;31m20221213235305135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235305135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235305135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235305135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235305135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235305135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235305148 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235305156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235305156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235305156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:08.472261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15175): Terminating (SIGTERM) 23:53:08.514662 run iperf3-srv_10.42.42.10(pid=15176): Terminating (SIGTERM) 23:53:08.556554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15177): Terminating (SIGTERM) 23:53:08.598506 run iperf3-srv_10.42.42.10(pid=15178): Terminating (SIGTERM) 23:53:08.640319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15181): Terminating (SIGTERM) 23:53:08.682616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15184): Terminating (SIGTERM) 23:53:08.724440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15187): Terminating (SIGTERM) 23:53:08.766644 --- ParallelTerminationStrategy: PID 15175 died... 23:53:08.787195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15175): Terminated: ok {rc=0} 23:53:08.833649 --- ParallelTerminationStrategy: PID 15176 died... 23:53:08.853420 run iperf3-srv_10.42.42.10(pid=15176): Terminated {rc=256} 23:53:08.899341 --- ParallelTerminationStrategy: PID 15177 died... 23:53:08.919503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15177): Terminated: ok {rc=0} 23:53:08.965694 --- ParallelTerminationStrategy: PID 15178 died... 23:53:08.985803 run iperf3-srv_10.42.42.10(pid=15178): Terminated {rc=256} 23:53:09.032023 --- ParallelTerminationStrategy: PID 15181 died... 23:53:09.052068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15181): Terminated: ok {rc=0} 23:53:09.098527 --- ParallelTerminationStrategy: PID 15184 died... 23:53:09.118601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15184): Terminated: ok {rc=0} 23:53:09.164752 --- ParallelTerminationStrategy: PID 15187 died... 23:53:09.184887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15187): Terminated: ok {rc=0} 23:53:09.272418 bus /gobi_0: Setting Powered False 23:53:10.370017 bus /gobi_0: Setting Powered False 23:53:11.485135 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:53:12.632609 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:12.644613 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:53:12.716029 tst iperf3.py: using LAC 37101 23:53:12.842975 tst iperf3.py: using RAC 126 23:53:12.970032 tst iperf3.py: using CellId 37101 23:53:13.097608 tst iperf3.py: using BVCI 37102 23:53:13.216561 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:13.228149 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:13.239561 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:13.250901 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:13.262682 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:13.274529 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:13.286423 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:13.298373 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:13.310297 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:13.426924 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:53:13.629786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:13.930879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15189): Launched 23:53:14.191525 run iperf3-srv_10.42.42.10(pid=15190): Launched 23:53:14.303779 tst iperf3.py:8: start network... 23:53:14.506100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:53:14.970234 run create_hlr_db(pid=15191): Launched 23:53:15.092929 bus /gobi_6: Setting Powered False 23:53:16.169495 run create_hlr_db(pid=15191): Terminated: ok {rc=0} 23:53:16.694392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15193): Launched 23:53:17.044247 run osmo-hlr_10.42.42.2(pid=15194): Launched 23:53:17.298863 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:17.923168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15196): Launched 23:53:18.215441 run osmo-stp_10.42.42.5(pid=15197): Launched 23:53:18.327340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:18.834524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15199): Launched 23:53:18.946438 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:19.194886 run patchelf(pid=15200): Launched 23:53:19.357595 run osmo-stp_10.42.42.5(pid=15197): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15197)] 23:53:19.481753 run osmo-stp_10.42.42.5(pid=15197): stdout: | (launched: 2022-12-13_23:53:18.161735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:19.607924 run osmo-stp_10.42.42.5(pid=15197): stderr: | [0;m[38;5;43m20221213235318331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235318331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235318332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235318332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235318333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235318333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235318333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:19.734085 run osmo-stp_10.42.42.5(pid=15197): stdout: | (launched: 2022-12-13_23:53:18.161735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:19.854692 run osmo-stp_10.42.42.5(pid=15197): stderr: | [0;m[38;5;43m20221213235318331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235318331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235318332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235318332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235318333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235318333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235318333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:19.997895 run patchelf(pid=15200): Terminating (SIGINT) 23:53:20.162816 run patchelf(pid=15200): Terminated: ok {rc=0} 23:53:20.281878 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15197): Process ended prematurely: osmo-stp_10.42.42.5(pid=15197) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15197)] [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 23:53:20.291085 tst iperf3.py:8: Test FAILED (7.7 sec) 23:53:20.317912 run osmo-hlr_10.42.42.2(pid=15194): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15194)] 23:53:20.364850 run osmo-hlr_10.42.42.2(pid=15194): stdout: | (launched: 2022-12-13_23:53:16.978532) 23:53:20.413614 run osmo-hlr_10.42.42.2(pid=15194): stderr: | [0;m[1;31m20221213235317290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235317290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235317290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235317290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235317290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235317291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235317314 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235317323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235317323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235317323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:20.462912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15189): Terminating (SIGTERM) 23:53:20.502346 run iperf3-srv_10.42.42.10(pid=15190): Terminating (SIGTERM) 23:53:20.541468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15193): Terminating (SIGTERM) 23:53:20.580703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15196): Terminating (SIGTERM) 23:53:20.620214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15199): Terminating (SIGTERM) 23:53:20.659717 --- ParallelTerminationStrategy: PID 15189 died... 23:53:20.678575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15189): Terminated: ok {rc=0} 23:53:20.721935 --- ParallelTerminationStrategy: PID 15190 died... 23:53:20.740130 run iperf3-srv_10.42.42.10(pid=15190): Terminated {rc=256} 23:53:20.783430 --- ParallelTerminationStrategy: PID 15193 died... 23:53:20.801891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15193): Terminated: ok {rc=0} 23:53:20.845086 --- ParallelTerminationStrategy: PID 15196 died... 23:53:20.863347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15196): Terminated: ok {rc=0} 23:53:20.906616 --- ParallelTerminationStrategy: PID 15199 died... 23:53:20.924834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15199): Terminated: ok {rc=0} 23:53:21.007428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:53:22.154959 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:22.167255 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:53:22.238465 tst iperf3m4.py: using LAC 37102 23:53:22.362392 tst iperf3m4.py: using RAC 127 23:53:22.484364 tst iperf3m4.py: using CellId 37102 23:53:22.608110 tst iperf3m4.py: using BVCI 37103 23:53:22.721856 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:22.733057 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:22.744110 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:22.755128 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:22.766608 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:22.778073 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:22.789582 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:22.800700 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:22.812327 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:22.931179 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:23.049495 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:23.167286 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:23.286630 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:53:23.499092 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:23.813952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15201): Launched 23:53:24.085867 run iperf3-srv_10.42.42.10(pid=15202): Launched 23:53:24.203782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:53:24.415729 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:24.731810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15203): Launched 23:53:25.004523 run iperf3-srv_10.42.42.10(pid=15204): Launched 23:53:25.122324 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:53:25.334363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:25.649720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15205): Launched 23:53:25.921650 run iperf3-srv_10.42.42.10(pid=15206): Launched 23:53:26.039357 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:53:26.251325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:26.567357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15207): Launched 23:53:26.840404 run iperf3-srv_10.42.42.10(pid=15208): Launched 23:53:26.957989 tst iperf3m4.py:8: start network... 23:53:27.169784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:53:27.657696 run create_hlr_db(pid=15209): Launched 23:53:27.777236 bus /gobi_6: Setting Powered False 23:53:28.840361 run create_hlr_db(pid=15209): Terminated: ok {rc=0} 23:53:29.279528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15211): Launched 23:53:29.594329 run osmo-hlr_10.42.42.2(pid=15212): Launched 23:53:29.714371 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:30.240485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15214): Launched 23:53:30.534832 run osmo-stp_10.42.42.5(pid=15215): Launched 23:53:30.647383 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:31.184080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15217): Launched 23:53:31.302588 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:31.561793 run patchelf(pid=15218): Launched 23:53:31.752650 run osmo-stp_10.42.42.5(pid=15215): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15215)] 23:53:31.892239 run osmo-stp_10.42.42.5(pid=15215): stdout: | (launched: 2022-12-13_23:53:30.480478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:32.032548 run osmo-stp_10.42.42.5(pid=15215): stderr: | [0;m[38;5;43m20221213235330648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235330649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235330649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235330649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235330650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235330650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235330650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:32.174071 run osmo-stp_10.42.42.5(pid=15215): stdout: | (launched: 2022-12-13_23:53:30.480478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:32.308210 run osmo-stp_10.42.42.5(pid=15215): stderr: | [0;m[38;5;43m20221213235330648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235330649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235330649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235330649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235330650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235330650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235330650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:32.463292 run patchelf(pid=15218): Terminating (SIGINT) 23:53:32.642515 run patchelf(pid=15218): Terminated: ok {rc=0} 23:53:32.771255 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15215): Process ended prematurely: osmo-stp_10.42.42.5(pid=15215) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15215)] [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:53:32.781625 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:53:32.810661 run osmo-hlr_10.42.42.2(pid=15212): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15212)] 23:53:32.863479 run osmo-hlr_10.42.42.2(pid=15212): stdout: | (launched: 2022-12-13_23:53:29.537174) 23:53:32.916795 run osmo-hlr_10.42.42.2(pid=15212): stderr: | [0;m[1;31m20221213235329733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235329733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235329733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235329733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235329733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235329733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235329748 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235329758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235329758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235329758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:32.970252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15201): Terminating (SIGTERM) 23:53:33.013193 run iperf3-srv_10.42.42.10(pid=15202): Terminating (SIGTERM) 23:53:33.055976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15203): Terminating (SIGTERM) 23:53:33.099767 run iperf3-srv_10.42.42.10(pid=15204): Terminating (SIGTERM) 23:53:33.142769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15205): Terminating (SIGTERM) 23:53:33.185638 run iperf3-srv_10.42.42.10(pid=15206): Terminating (SIGTERM) 23:53:33.228225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15207): Terminating (SIGTERM) 23:53:33.271040 run iperf3-srv_10.42.42.10(pid=15208): Terminating (SIGTERM) 23:53:33.313700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15211): Terminating (SIGTERM) 23:53:33.356941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15214): Terminating (SIGTERM) 23:53:33.399923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15217): Terminating (SIGTERM) 23:53:33.442896 --- ParallelTerminationStrategy: PID 15201 died... 23:53:33.463265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15201): Terminated: ok {rc=0} 23:53:33.510243 --- ParallelTerminationStrategy: PID 15202 died... 23:53:33.530188 run iperf3-srv_10.42.42.10(pid=15202): Terminated {rc=256} 23:53:33.576829 --- ParallelTerminationStrategy: PID 15203 died... 23:53:33.597187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15203): Terminated: ok {rc=0} 23:53:33.643478 --- ParallelTerminationStrategy: PID 15204 died... 23:53:33.663535 run iperf3-srv_10.42.42.10(pid=15204): Terminated {rc=256} 23:53:33.709856 --- ParallelTerminationStrategy: PID 15205 died... 23:53:33.729942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15205): Terminated: ok {rc=0} 23:53:33.776495 --- ParallelTerminationStrategy: PID 15206 died... 23:53:33.796462 run iperf3-srv_10.42.42.10(pid=15206): Terminated {rc=256} 23:53:33.842757 --- ParallelTerminationStrategy: PID 15207 died... 23:53:33.862794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15207): Terminated: ok {rc=0} 23:53:33.909419 --- ParallelTerminationStrategy: PID 15208 died... 23:53:33.929409 run iperf3-srv_10.42.42.10(pid=15208): Terminated {rc=256} 23:53:33.975719 --- ParallelTerminationStrategy: PID 15211 died... 23:53:33.995917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15211): Terminated: ok {rc=0} 23:53:34.042271 --- ParallelTerminationStrategy: PID 15214 died... 23:53:34.062324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15214): Terminated: ok {rc=0} 23:53:34.108875 --- ParallelTerminationStrategy: PID 15217 died... 23:53:34.129346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15217): Terminated: ok {rc=0} 23:53:34.218803 bus /gobi_4: Setting Powered False 23:53:35.316115 bus /gobi_4: Setting Powered False 23:53:36.431691 bus /gobi_1: Setting Powered False 23:53:37.530249 bus /gobi_1: Setting Powered False 23:53:38.646541 bus /gobi_0: Setting Powered False 23:53:39.743128 bus /gobi_0: Setting Powered False 23:53:40.858045 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:53:41.960156 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:41.971682 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:53:42.043603 tst ping.py: using LAC 37103 23:53:42.166473 tst ping.py: using RAC 128 23:53:42.281934 tst ping.py: using CellId 37103 23:53:42.394421 tst ping.py: using BVCI 37104 23:53:42.499854 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:42.510916 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:42.521664 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:42.532772 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:42.543537 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:42.554461 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:42.565988 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:42.576739 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:42.691070 tst ping.py:19: start network... 23:53:42.884800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:53:43.336510 run create_hlr_db(pid=15219): Launched 23:53:43.454957 bus /gobi_6: Setting Powered False 23:53:44.514196 run create_hlr_db(pid=15219): Terminated: ok {rc=0} 23:53:44.940315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15221): Launched 23:53:45.249400 run osmo-hlr_10.42.42.2(pid=15222): Launched 23:53:45.367705 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:45.925839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15224): Launched 23:53:46.239497 run osmo-stp_10.42.42.5(pid=15225): Launched 23:53:46.472838 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:47.036061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15227): Launched 23:53:47.158007 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:47.411230 run patchelf(pid=15228): Launched 23:53:47.572709 run osmo-stp_10.42.42.5(pid=15225): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15225)] 23:53:47.696365 run osmo-stp_10.42.42.5(pid=15225): stdout: | (launched: 2022-12-13_23:53:46.177731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:47.821480 run osmo-stp_10.42.42.5(pid=15225): stderr: | [0;m[38;5;43m20221213235346544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235346544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235346544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235346554 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235346554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235346554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235346554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:47.946617 run osmo-stp_10.42.42.5(pid=15225): stdout: | (launched: 2022-12-13_23:53:46.177731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:48.066102 run osmo-stp_10.42.42.5(pid=15225): stderr: | [0;m[38;5;43m20221213235346544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235346544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235346544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235346554 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235346554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235346554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235346554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:48.207771 run patchelf(pid=15228): Terminating (SIGINT) 23:53:48.370776 run patchelf(pid=15228): Terminated: ok {rc=0} 23:53:48.488311 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15225): Process ended prematurely: osmo-stp_10.42.42.5(pid=15225) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15225)] [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 23:53:48.497212 tst ping.py:22: Test FAILED (6.5 sec) 23:53:48.523502 run osmo-hlr_10.42.42.2(pid=15222): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15222)] 23:53:48.570574 run osmo-hlr_10.42.42.2(pid=15222): stdout: | (launched: 2022-12-13_23:53:45.192891) 23:53:48.619886 run osmo-hlr_10.42.42.2(pid=15222): stderr: | [0;m[1;31m20221213235345389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235345389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235345389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235345389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235345389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235345389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235345405 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235345413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235345413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235345413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:48.669230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15221): Terminating (SIGTERM) 23:53:48.709278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15224): Terminating (SIGTERM) 23:53:48.748604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15227): Terminating (SIGTERM) 23:53:48.788126 --- ParallelTerminationStrategy: PID 15221 died... 23:53:48.807268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15221): Terminated: ok {rc=0} 23:53:48.850839 --- ParallelTerminationStrategy: PID 15224 died... 23:53:48.869269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15224): Terminated: ok {rc=0} 23:53:48.912353 --- ParallelTerminationStrategy: PID 15227 died... 23:53:48.930895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15227): Terminated: ok {rc=0} 23:53:49.015454 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:53:50.102958 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:50.114417 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:53:50.185415 tst ping_idle_ping.py: using LAC 37104 23:53:50.301363 tst ping_idle_ping.py: using RAC 129 23:53:50.415117 tst ping_idle_ping.py: using CellId 37104 23:53:50.530634 tst ping_idle_ping.py: using BVCI 37105 23:53:50.635845 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:50.646933 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:50.657645 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:50.668254 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:50.678938 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:50.689604 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:50.701111 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:50.712229 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:50.830429 tst ping_idle_ping.py:24: start network... 23:53:51.039302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:53:51.518249 run create_hlr_db(pid=15229): Launched 23:53:51.637706 bus /gobi_6: Setting Powered False 23:53:52.699309 run create_hlr_db(pid=15229): Terminated: ok {rc=0} 23:53:53.117602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15231): Launched 23:53:53.408118 run osmo-hlr_10.42.42.2(pid=15232): Launched 23:53:53.518093 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:54.038480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15234): Launched 23:53:54.330296 run osmo-stp_10.42.42.5(pid=15235): Launched 23:53:54.440258 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:54.943177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15237): Launched 23:53:55.053687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:55.299304 run patchelf(pid=15238): Launched 23:53:55.460453 run osmo-stp_10.42.42.5(pid=15235): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15235)] 23:53:55.583674 run osmo-stp_10.42.42.5(pid=15235): stdout: | (launched: 2022-12-13_23:53:54.277212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:55.708815 run osmo-stp_10.42.42.5(pid=15235): stderr: | [0;m[38;5;43m20221213235354446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235354446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235354446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235354446 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235354449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235354449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235354449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:55.833810 run osmo-stp_10.42.42.5(pid=15235): stdout: | (launched: 2022-12-13_23:53:54.277212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:55.953884 run osmo-stp_10.42.42.5(pid=15235): stderr: | [0;m[38;5;43m20221213235354446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235354446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235354446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235354446 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235354449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235354449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235354449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:56.095377 run patchelf(pid=15238): Terminating (SIGINT) 23:53:56.260010 run patchelf(pid=15238): Terminated: ok {rc=0} 23:53:56.378301 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15235): Process ended prematurely: osmo-stp_10.42.42.5(pid=15235) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15235)] [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:53:56.386993 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 23:53:56.413356 run osmo-hlr_10.42.42.2(pid=15232): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15232)] 23:53:56.460757 run osmo-hlr_10.42.42.2(pid=15232): stdout: | (launched: 2022-12-13_23:53:53.354544) 23:53:56.509517 run osmo-hlr_10.42.42.2(pid=15232): stderr: | [0;m[1;31m20221213235353529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235353529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235353529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235353529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235353530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235353530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235353542 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235353550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235353550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235353550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:56.558534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15231): Terminating (SIGTERM) 23:53:56.597856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15234): Terminating (SIGTERM) 23:53:56.636931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15237): Terminating (SIGTERM) 23:53:56.676506 --- ParallelTerminationStrategy: PID 15231 died... 23:53:56.695306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15231): Terminated: ok {rc=0} 23:53:56.738672 --- ParallelTerminationStrategy: PID 15234 died... 23:53:56.757288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15234): Terminated: ok {rc=0} 23:53:56.800542 --- ParallelTerminationStrategy: PID 15237 died... 23:53:56.818872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15237): Terminated: ok {rc=0} 23:53:56.903183 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:53:58.202641 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:53:58.208441 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:53:58.240269 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:53:58.278386 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:53:58.364901 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:53:58.397628 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:53:58.435749 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:53:59.027872 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:53:59.075336 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.086195 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:53:59.154329 tst cs_paging_gprs_active.py: using LAC 37105 23:53:59.270246 tst cs_paging_gprs_active.py: using RAC 130 23:53:59.387876 tst cs_paging_gprs_active.py: using CellId 37105 23:53:59.505719 tst cs_paging_gprs_active.py: using BVCI 37106 23:53:59.615222 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.626126 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.636719 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.647455 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.658099 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.669217 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.680211 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.690873 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.701831 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:53:59.820097 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:53:59.941047 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:54:00.140082 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:00.438430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15243): Launched 23:54:00.697454 run iperf3-srv_10.42.42.10(pid=15244): Launched 23:54:00.809629 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:54:01.014434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:01.350223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15255): Launched 23:54:01.669731 run iperf3-srv_10.42.42.10(pid=15282): Launched 23:54:01.791313 tst cs_paging_gprs_active.py:38: start network... 23:54:02.010139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:02.563311 run create_hlr_db(pid=15303): Launched 23:54:02.734036 bus /gobi_6: Setting Powered False 23:54:03.812924 run create_hlr_db(pid=15303): Terminated: ok {rc=0} 23:54:04.281763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15519): Launched 23:54:04.612239 run osmo-hlr_10.42.42.2(pid=15520): Launched 23:54:04.859733 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:05.532920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15522): Launched 23:54:05.874276 run osmo-stp_10.42.42.5(pid=15523): Launched 23:54:06.069441 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:06.725798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15527): Launched 23:54:06.852395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:07.145762 run patchelf(pid=15528): Launched 23:54:07.334442 run osmo-stp_10.42.42.5(pid=15523): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15523)] 23:54:07.472052 run osmo-stp_10.42.42.5(pid=15523): stdout: | (launched: 2022-12-13_23:54:05.808770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:07.614910 run osmo-stp_10.42.42.5(pid=15523): stderr: | [0;m[38;5;43m20221213235406095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235406096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235406096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235406096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235406097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235406097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235406097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:07.757415 run osmo-stp_10.42.42.5(pid=15523): stdout: | (launched: 2022-12-13_23:54:05.808770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:07.892844 run osmo-stp_10.42.42.5(pid=15523): stderr: | [0;m[38;5;43m20221213235406095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235406096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235406096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235406096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235406097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235406097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235406097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:08.050638 run patchelf(pid=15528): Terminating (SIGINT) 23:54:08.234434 run patchelf(pid=15528): Terminated: ok {rc=0} 23:54:08.367192 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15523): Process ended prematurely: osmo-stp_10.42.42.5(pid=15523) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15523)] [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:54:08.378366 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 23:54:08.407663 run osmo-hlr_10.42.42.2(pid=15520): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15520)] 23:54:08.462174 run osmo-hlr_10.42.42.2(pid=15520): stdout: | (launched: 2022-12-13_23:54:04.547404) 23:54:08.517215 run osmo-hlr_10.42.42.2(pid=15520): stderr: | [0;m[1;31m20221213235404865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235404865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235404865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235404865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235404865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235404865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235404885 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235404899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235404899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235404899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:08.572609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15243): Terminating (SIGTERM) 23:54:08.616243 run iperf3-srv_10.42.42.10(pid=15244): Terminating (SIGTERM) 23:54:08.663949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15255): Terminating (SIGTERM) 23:54:08.709076 run iperf3-srv_10.42.42.10(pid=15282): Terminating (SIGTERM) 23:54:08.752749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15519): Terminating (SIGTERM) 23:54:08.797036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15522): Terminating (SIGTERM) 23:54:08.841986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15527): Terminating (SIGTERM) 23:54:08.889354 --- ParallelTerminationStrategy: PID 15243 died... 23:54:08.911754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15243): Terminated: ok {rc=0} 23:54:08.961576 --- ParallelTerminationStrategy: PID 15244 died... 23:54:08.983241 run iperf3-srv_10.42.42.10(pid=15244): Terminated {rc=256} 23:54:09.031815 --- ParallelTerminationStrategy: PID 15255 died... 23:54:09.053525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15255): Terminated: ok {rc=0} 23:54:09.103295 --- ParallelTerminationStrategy: PID 15282 died... 23:54:09.124593 run iperf3-srv_10.42.42.10(pid=15282): Terminated {rc=256} 23:54:09.172942 --- ParallelTerminationStrategy: PID 15519 died... 23:54:09.194580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15519): Terminated: ok {rc=0} 23:54:09.244620 --- ParallelTerminationStrategy: PID 15522 died... 23:54:09.266307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15522): Terminated: ok {rc=0} 23:54:09.315748 --- ParallelTerminationStrategy: PID 15527 died... 23:54:09.337849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15527): Terminated: ok {rc=0} 23:54:09.430130 bus /gobi_0: Setting Powered False 23:54:10.533862 bus /gobi_0: Setting Powered False 23:54:11.654005 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:54:12.804066 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:12.816171 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:54:12.888062 tst iperf3.py: using LAC 37106 23:54:13.007376 tst iperf3.py: using RAC 131 23:54:13.128848 tst iperf3.py: using CellId 37106 23:54:13.250831 tst iperf3.py: using BVCI 37107 23:54:13.364178 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:13.375660 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:13.387107 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:13.398741 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:13.410595 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:13.422525 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:13.434665 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:13.446542 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:13.458588 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:13.580887 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:54:13.787001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:14.110186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15529): Launched 23:54:14.394010 run iperf3-srv_10.42.42.10(pid=15530): Launched 23:54:14.518019 tst iperf3.py:8: start network... 23:54:14.724301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:15.203580 run create_hlr_db(pid=15531): Launched 23:54:15.365844 bus /gobi_6: Setting Powered False 23:54:16.451476 run create_hlr_db(pid=15531): Terminated: ok {rc=0} 23:54:17.018595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15533): Launched 23:54:17.406767 run osmo-hlr_10.42.42.2(pid=15534): Launched 23:54:17.691806 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:18.429761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15536): Launched 23:54:18.761760 run osmo-stp_10.42.42.5(pid=15537): Launched 23:54:18.990306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:19.706315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15539): Launched 23:54:19.835178 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:20.105930 run patchelf(pid=15540): Launched 23:54:20.291505 run osmo-stp_10.42.42.5(pid=15537): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15537)] 23:54:20.422451 run osmo-stp_10.42.42.5(pid=15537): stdout: | (launched: 2022-12-13_23:54:18.689461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:20.556565 run osmo-stp_10.42.42.5(pid=15537): stderr: | [0;m[38;5;43m20221213235419029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235419029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235419030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235419030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235419031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235419031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235419031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:20.691355 run osmo-stp_10.42.42.5(pid=15537): stdout: | (launched: 2022-12-13_23:54:18.689461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:20.819395 run osmo-stp_10.42.42.5(pid=15537): stderr: | [0;m[38;5;43m20221213235419029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235419029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235419030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235419030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235419031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235419031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235419031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:20.971162 run patchelf(pid=15540): Terminating (SIGINT) 23:54:21.146361 run patchelf(pid=15540): Terminated: ok {rc=0} 23:54:21.274681 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15537): Process ended prematurely: osmo-stp_10.42.42.5(pid=15537) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15537)] [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 23:54:21.285580 tst iperf3.py:8: Test FAILED (8.5 sec) 23:54:21.314180 run osmo-hlr_10.42.42.2(pid=15534): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15534)] 23:54:21.366255 run osmo-hlr_10.42.42.2(pid=15534): stdout: | (launched: 2022-12-13_23:54:17.338425) 23:54:21.417727 run osmo-hlr_10.42.42.2(pid=15534): stderr: | [0;m[1;31m20221213235417582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235417582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235417583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235417583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235417583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235417583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235417601 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235417621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235417622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235417622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:21.469367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15529): Terminating (SIGTERM) 23:54:21.512450 run iperf3-srv_10.42.42.10(pid=15530): Terminating (SIGTERM) 23:54:21.557375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15533): Terminating (SIGTERM) 23:54:21.600695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15536): Terminating (SIGTERM) 23:54:21.644363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15539): Terminating (SIGTERM) 23:54:21.689958 --- ParallelTerminationStrategy: PID 15529 died... 23:54:21.709747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15529): Terminated: ok {rc=0} 23:54:21.757656 --- ParallelTerminationStrategy: PID 15530 died... 23:54:21.777079 run iperf3-srv_10.42.42.10(pid=15530): Terminated {rc=256} 23:54:21.823092 --- ParallelTerminationStrategy: PID 15533 died... 23:54:21.842871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15533): Terminated: ok {rc=0} 23:54:21.889824 --- ParallelTerminationStrategy: PID 15536 died... 23:54:21.909823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15536): Terminated: ok {rc=0} 23:54:21.955252 --- ParallelTerminationStrategy: PID 15539 died... 23:54:21.974761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15539): Terminated: ok {rc=0} 23:54:22.064202 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:54:23.215996 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:23.228818 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:54:23.302329 tst iperf3m4.py: using LAC 37107 23:54:23.422780 tst iperf3m4.py: using RAC 132 23:54:23.546276 tst iperf3m4.py: using CellId 37107 23:54:23.666546 tst iperf3m4.py: using BVCI 37108 23:54:23.779824 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:23.792365 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:23.804287 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:23.816248 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:23.828280 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:23.840398 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:23.852655 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:23.864677 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:23.878171 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:23.999622 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:24.121055 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:24.242335 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:24.362682 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:54:24.570495 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:24.892004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15542): Launched 23:54:25.167205 run iperf3-srv_10.42.42.10(pid=15543): Launched 23:54:25.285614 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:54:25.499274 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:25.817121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15544): Launched 23:54:26.091336 run iperf3-srv_10.42.42.10(pid=15545): Launched 23:54:26.209689 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:54:26.422708 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:26.740232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15546): Launched 23:54:27.014962 run iperf3-srv_10.42.42.10(pid=15547): Launched 23:54:27.133348 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:54:27.346712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:27.664876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15548): Launched 23:54:27.939491 run iperf3-srv_10.42.42.10(pid=15549): Launched 23:54:28.058252 tst iperf3m4.py:8: start network... 23:54:28.271441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:28.761384 run create_hlr_db(pid=15550): Launched 23:54:28.882078 bus /gobi_6: Setting Powered False 23:54:29.945208 run create_hlr_db(pid=15550): Terminated: ok {rc=0} 23:54:30.386743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15552): Launched 23:54:30.703748 run osmo-hlr_10.42.42.2(pid=15553): Launched 23:54:30.825100 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:31.505776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15555): Launched 23:54:31.831363 run osmo-stp_10.42.42.5(pid=15556): Launched 23:54:32.066762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:32.693697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15558): Launched 23:54:32.807235 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:33.058218 run patchelf(pid=15559): Launched 23:54:33.222575 run osmo-stp_10.42.42.5(pid=15556): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15556)] 23:54:33.347844 run osmo-stp_10.42.42.5(pid=15556): stdout: | (launched: 2022-12-13_23:54:31.767399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:33.474840 run osmo-stp_10.42.42.5(pid=15556): stderr: | [0;m[38;5;43m20221213235432105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235432105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235432105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235432106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235432106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235432106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235432106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:33.602060 run osmo-stp_10.42.42.5(pid=15556): stdout: | (launched: 2022-12-13_23:54:31.767399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:33.723476 run osmo-stp_10.42.42.5(pid=15556): stderr: | [0;m[38;5;43m20221213235432105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235432105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235432105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235432106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235432106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235432106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235432106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:33.866949 run patchelf(pid=15559): Terminating (SIGINT) 23:54:34.033222 run patchelf(pid=15559): Terminated: ok {rc=0} 23:54:34.152618 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15556): Process ended prematurely: osmo-stp_10.42.42.5(pid=15556) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15556)] [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:54:34.162120 tst iperf3m4.py:8: Test FAILED (11.0 sec) 23:54:34.189058 run osmo-hlr_10.42.42.2(pid=15553): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15553)] 23:54:34.236409 run osmo-hlr_10.42.42.2(pid=15553): stdout: | (launched: 2022-12-13_23:54:30.646141) 23:54:34.285776 run osmo-hlr_10.42.42.2(pid=15553): stderr: | [0;m[1;31m20221213235430845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235430845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235430845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235430845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235430845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235430845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235430856 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235430869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235430869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235430869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:34.335438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15542): Terminating (SIGTERM) 23:54:34.374725 run iperf3-srv_10.42.42.10(pid=15543): Terminating (SIGTERM) 23:54:34.415394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15544): Terminating (SIGTERM) 23:54:34.454966 run iperf3-srv_10.42.42.10(pid=15545): Terminating (SIGTERM) 23:54:34.493835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15546): Terminating (SIGTERM) 23:54:34.532767 run iperf3-srv_10.42.42.10(pid=15547): Terminating (SIGTERM) 23:54:34.571620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15548): Terminating (SIGTERM) 23:54:34.610654 run iperf3-srv_10.42.42.10(pid=15549): Terminating (SIGTERM) 23:54:34.649454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15552): Terminating (SIGTERM) 23:54:34.688338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15555): Terminating (SIGTERM) 23:54:34.727212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15558): Terminating (SIGTERM) 23:54:34.766495 --- ParallelTerminationStrategy: PID 15542 died... 23:54:34.785207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15542): Terminated: ok {rc=0} 23:54:34.828858 --- ParallelTerminationStrategy: PID 15543 died... 23:54:34.847823 run iperf3-srv_10.42.42.10(pid=15543): Terminated {rc=256} 23:54:34.890970 --- ParallelTerminationStrategy: PID 15544 died... 23:54:34.909267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15544): Terminated: ok {rc=0} 23:54:34.952704 --- ParallelTerminationStrategy: PID 15545 died... 23:54:34.971524 run iperf3-srv_10.42.42.10(pid=15545): Terminated {rc=256} 23:54:35.014722 --- ParallelTerminationStrategy: PID 15546 died... 23:54:35.032935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15546): Terminated: ok {rc=0} 23:54:35.076855 --- ParallelTerminationStrategy: PID 15547 died... 23:54:35.095790 run iperf3-srv_10.42.42.10(pid=15547): Terminated {rc=256} 23:54:35.139191 --- ParallelTerminationStrategy: PID 15548 died... 23:54:35.157718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15548): Terminated: ok {rc=0} 23:54:35.201237 --- ParallelTerminationStrategy: PID 15549 died... 23:54:35.219542 run iperf3-srv_10.42.42.10(pid=15549): Terminated {rc=256} 23:54:35.262789 --- ParallelTerminationStrategy: PID 15552 died... 23:54:35.281167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15552): Terminated: ok {rc=0} 23:54:35.324298 --- ParallelTerminationStrategy: PID 15555 died... 23:54:35.342788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15555): Terminated: ok {rc=0} 23:54:35.386055 --- ParallelTerminationStrategy: PID 15558 died... 23:54:35.404559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15558): Terminated: ok {rc=0} 23:54:35.487703 bus /gobi_4: Setting Powered False 23:54:36.582446 bus /gobi_4: Setting Powered False 23:54:37.696394 bus /gobi_1: Setting Powered False 23:54:38.795432 bus /gobi_1: Setting Powered False 23:54:39.910694 bus /gobi_0: Setting Powered False 23:54:41.008902 bus /gobi_0: Setting Powered False 23:54:42.124795 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:54:43.226888 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:43.238514 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:54:43.308416 tst ping.py: using LAC 37108 23:54:43.422611 tst ping.py: using RAC 133 23:54:43.538673 tst ping.py: using CellId 37108 23:54:43.652858 tst ping.py: using BVCI 37109 23:54:43.758041 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:43.768812 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:43.779486 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:43.790147 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:43.800695 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:43.811394 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:43.822206 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:43.832769 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:43.947684 tst ping.py:19: start network... 23:54:44.142523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:44.594816 run create_hlr_db(pid=15560): Launched 23:54:44.713666 bus /gobi_6: Setting Powered False 23:54:45.772548 run create_hlr_db(pid=15560): Terminated: ok {rc=0} 23:54:46.232619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15562): Launched 23:54:46.574034 run osmo-hlr_10.42.42.2(pid=15563): Launched 23:54:46.701156 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:47.485625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15565): Launched 23:54:47.795367 run osmo-stp_10.42.42.5(pid=15566): Launched 23:54:47.913561 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:48.448359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15568): Launched 23:54:48.567748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:48.830317 run patchelf(pid=15569): Launched 23:54:49.002715 run osmo-stp_10.42.42.5(pid=15566): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15566)] 23:54:49.134684 run osmo-stp_10.42.42.5(pid=15566): stdout: | (launched: 2022-12-13_23:54:47.739002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:49.268424 run osmo-stp_10.42.42.5(pid=15566): stderr: | [0;m[38;5;43m20221213235447929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235447929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235447929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235447929 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235447930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235447930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235447930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:49.401868 run osmo-stp_10.42.42.5(pid=15566): stdout: | (launched: 2022-12-13_23:54:47.739002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:49.529740 run osmo-stp_10.42.42.5(pid=15566): stderr: | [0;m[38;5;43m20221213235447929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235447929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235447929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235447929 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235447930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235447930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235447930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:49.681133 run patchelf(pid=15569): Terminating (SIGINT) 23:54:49.855013 run patchelf(pid=15569): Terminated: ok {rc=0} 23:54:49.980150 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15566): Process ended prematurely: osmo-stp_10.42.42.5(pid=15566) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15566)] [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 23:54:49.989678 tst ping.py:22: Test FAILED (6.8 sec) 23:54:50.017622 run osmo-hlr_10.42.42.2(pid=15563): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15563)] 23:54:50.068037 run osmo-hlr_10.42.42.2(pid=15563): stdout: | (launched: 2022-12-13_23:54:46.506808) 23:54:50.119920 run osmo-hlr_10.42.42.2(pid=15563): stderr: | [0;m[1;31m20221213235446995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235446995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235446995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235446995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235446995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235446996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235447029 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235447056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235447056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235447056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:50.172207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15562): Terminating (SIGTERM) 23:54:50.213956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15565): Terminating (SIGTERM) 23:54:50.255580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15568): Terminating (SIGTERM) 23:54:50.297611 --- ParallelTerminationStrategy: PID 15562 died... 23:54:50.317956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15562): Terminated: ok {rc=0} 23:54:50.364308 --- ParallelTerminationStrategy: PID 15565 died... 23:54:50.384103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15565): Terminated: ok {rc=0} 23:54:50.430560 --- ParallelTerminationStrategy: PID 15568 died... 23:54:50.450515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15568): Terminated: ok {rc=0} 23:54:50.538721 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:54:51.626167 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:51.638002 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:54:51.714560 tst ping_idle_ping.py: using LAC 37109 23:54:51.839705 tst ping_idle_ping.py: using RAC 134 23:54:51.957183 tst ping_idle_ping.py: using CellId 37109 23:54:52.072723 tst ping_idle_ping.py: using BVCI 37110 23:54:52.179428 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:52.190503 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:52.201471 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:52.212346 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:52.223230 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:52.234024 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:52.244656 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:52.256134 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:52.370086 tst ping_idle_ping.py:24: start network... 23:54:52.566814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:53.020375 run create_hlr_db(pid=15570): Launched 23:54:53.140025 bus /gobi_6: Setting Powered False 23:54:54.199249 run create_hlr_db(pid=15570): Terminated: ok {rc=0} 23:54:54.609135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15572): Launched 23:54:54.900679 run osmo-hlr_10.42.42.2(pid=15573): Launched 23:54:55.011541 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:55.517384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15575): Launched 23:54:55.809781 run osmo-stp_10.42.42.5(pid=15576): Launched 23:54:55.920754 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:56.425957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15578): Launched 23:54:56.537288 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:56.783837 run patchelf(pid=15579): Launched 23:54:56.946077 run osmo-stp_10.42.42.5(pid=15576): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15576)] 23:54:57.070739 run osmo-stp_10.42.42.5(pid=15576): stdout: | (launched: 2022-12-13_23:54:55.756318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:57.196590 run osmo-stp_10.42.42.5(pid=15576): stderr: | [0;m[38;5;43m20221213235455926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235455926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235455926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235455927 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235455927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235455927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235455927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:57.323017 run osmo-stp_10.42.42.5(pid=15576): stdout: | (launched: 2022-12-13_23:54:55.756318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:57.443480 run osmo-stp_10.42.42.5(pid=15576): stderr: | [0;m[38;5;43m20221213235455926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235455926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235455926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235455927 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235455927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235455927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235455927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:57.586262 run patchelf(pid=15579): Terminating (SIGINT) 23:54:57.751043 run patchelf(pid=15579): Terminated: ok {rc=0} 23:54:57.869839 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15576): Process ended prematurely: osmo-stp_10.42.42.5(pid=15576) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15576)] [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:54:57.878701 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 23:54:57.905038 run osmo-hlr_10.42.42.2(pid=15573): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15573)] 23:54:57.952246 run osmo-hlr_10.42.42.2(pid=15573): stdout: | (launched: 2022-12-13_23:54:54.847048) 23:54:58.001333 run osmo-hlr_10.42.42.2(pid=15573): stderr: | [0;m[1;31m20221213235455019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235455019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235455019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235455020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235455020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235455020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235455032 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235455041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235455041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235455041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:58.050876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15572): Terminating (SIGTERM) 23:54:58.090374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15575): Terminating (SIGTERM) 23:54:58.129925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15578): Terminating (SIGTERM) 23:54:58.169930 --- ParallelTerminationStrategy: PID 15572 died... 23:54:58.189217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15572): Terminated: ok {rc=0} 23:54:58.232775 --- ParallelTerminationStrategy: PID 15575 died... 23:54:58.251512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15575): Terminated: ok {rc=0} 23:54:58.295261 --- ParallelTerminationStrategy: PID 15578 died... 23:54:58.313964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15578): Terminated: ok {rc=0} 23:54:58.399480 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:54:59.703225 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:54:59.709478 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:54:59.741194 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 23:54:59.779283 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 23:54:59.870972 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:54:59.903167 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 23:54:59.940879 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 23:55:00.540658 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 23:55:00.588459 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:00.599774 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:55:00.649442 tst cs_paging_gprs_active.py: using LAC 37110 23:55:00.764793 tst cs_paging_gprs_active.py: using RAC 135 23:55:00.879301 tst cs_paging_gprs_active.py: using CellId 37110 23:55:01.013048 tst cs_paging_gprs_active.py: using BVCI 37111 23:55:01.124493 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:01.136270 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:01.147880 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:01.159659 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:01.171490 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:01.183261 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:01.194931 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:01.206624 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:01.218366 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:01.339592 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:01.470840 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:55:01.693919 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:02.043058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15587): Launched 23:55:02.330912 run iperf3-srv_10.42.42.10(pid=15588): Launched 23:55:02.442457 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:55:02.641805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:02.942439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15589): Launched 23:55:03.200924 run iperf3-srv_10.42.42.10(pid=15590): Launched 23:55:03.313246 tst cs_paging_gprs_active.py:38: start network... 23:55:03.512410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:03.973370 run create_hlr_db(pid=15591): Launched 23:55:04.093967 bus /gobi_6: Setting Powered False 23:55:05.153619 run create_hlr_db(pid=15591): Terminated: ok {rc=0} 23:55:05.587687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15593): Launched 23:55:05.890035 run osmo-hlr_10.42.42.2(pid=15594): Launched 23:55:06.002926 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:06.527595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15596): Launched 23:55:06.824634 run osmo-stp_10.42.42.5(pid=15597): Launched 23:55:06.937742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:07.450842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15599): Launched 23:55:07.565061 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:07.816365 run patchelf(pid=15600): Launched 23:55:07.981558 run osmo-stp_10.42.42.5(pid=15597): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15597)] 23:55:08.107076 run osmo-stp_10.42.42.5(pid=15597): stdout: | (launched: 2022-12-13_23:55:06.770392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:08.234701 run osmo-stp_10.42.42.5(pid=15597): stderr: | [0;m[38;5;43m20221213235506943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235506943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235506944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235506944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235506944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235506944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235506945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:08.361913 run osmo-stp_10.42.42.5(pid=15597): stdout: | (launched: 2022-12-13_23:55:06.770392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:08.483441 run osmo-stp_10.42.42.5(pid=15597): stderr: | [0;m[38;5;43m20221213235506943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235506943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235506944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235506944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235506944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235506944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235506945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:08.627460 run patchelf(pid=15600): Terminating (SIGINT) 23:55:08.793890 run patchelf(pid=15600): Terminated: ok {rc=0} 23:55:08.914025 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15597): Process ended prematurely: osmo-stp_10.42.42.5(pid=15597) [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15597)] [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 23:55:08.923250 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 23:55:08.950162 run osmo-hlr_10.42.42.2(pid=15594): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15594)] 23:55:08.997761 run osmo-hlr_10.42.42.2(pid=15594): stdout: | (launched: 2022-12-13_23:55:05.835606) 23:55:09.046969 run osmo-hlr_10.42.42.2(pid=15594): stderr: | [0;m[1;31m20221213235506010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235506010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235506010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235506010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235506010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235506010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235506022 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235506032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235506032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235506032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:09.096832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15587): Terminating (SIGTERM) 23:55:09.136673 run iperf3-srv_10.42.42.10(pid=15588): Terminating (SIGTERM) 23:55:09.176291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15589): Terminating (SIGTERM) 23:55:09.215916 run iperf3-srv_10.42.42.10(pid=15590): Terminating (SIGTERM) 23:55:09.255403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15593): Terminating (SIGTERM) 23:55:09.295192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15596): Terminating (SIGTERM) 23:55:09.335117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15599): Terminating (SIGTERM) 23:55:09.375031 --- ParallelTerminationStrategy: PID 15587 died... 23:55:09.394039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15587): Terminated: ok {rc=0} 23:55:09.437846 --- ParallelTerminationStrategy: PID 15588 died... 23:55:09.456087 run iperf3-srv_10.42.42.10(pid=15588): Terminated {rc=256} 23:55:09.499448 --- ParallelTerminationStrategy: PID 15589 died... 23:55:09.517809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15589): Terminated: ok {rc=0} 23:55:09.561154 --- ParallelTerminationStrategy: PID 15590 died... 23:55:09.579360 run iperf3-srv_10.42.42.10(pid=15590): Terminated {rc=256} 23:55:09.622642 --- ParallelTerminationStrategy: PID 15593 died... 23:55:09.641054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15593): Terminated: ok {rc=0} 23:55:09.684250 --- ParallelTerminationStrategy: PID 15596 died... 23:55:09.702647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15596): Terminated: ok {rc=0} 23:55:09.746047 --- ParallelTerminationStrategy: PID 15599 died... 23:55:09.764387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15599): Terminated: ok {rc=0} 23:55:09.847087 bus /gobi_0: Setting Powered False 23:55:10.943625 bus /gobi_0: Setting Powered False 23:55:12.061564 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 23:55:13.206236 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:13.217997 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:55:13.272521 tst iperf3.py: using LAC 37111 23:55:13.390581 tst iperf3.py: using RAC 136 23:55:13.508055 tst iperf3.py: using CellId 37111 23:55:13.634113 tst iperf3.py: using BVCI 37112 23:55:13.751109 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:13.763020 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:13.774672 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:13.786375 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:13.798355 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:13.810190 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:13.822076 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:13.833837 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:13.845820 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:13.960508 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:55:14.159995 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:14.457534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15601): Launched 23:55:14.714893 run iperf3-srv_10.42.42.10(pid=15602): Launched 23:55:14.825487 tst iperf3.py:8: start network... 23:55:15.023362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:15.482517 run create_hlr_db(pid=15603): Launched 23:55:15.603471 bus /gobi_6: Setting Powered False 23:55:16.665766 run create_hlr_db(pid=15603): Terminated: ok {rc=0} 23:55:17.119544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15605): Launched 23:55:17.430046 run osmo-hlr_10.42.42.2(pid=15606): Launched 23:55:17.542226 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:18.068352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15608): Launched 23:55:18.364520 run osmo-stp_10.42.42.5(pid=15609): Launched 23:55:18.477190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:18.989014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15611): Launched 23:55:19.101890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:19.352635 run patchelf(pid=15612): Launched 23:55:19.518525 run osmo-stp_10.42.42.5(pid=15609): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15609)] 23:55:19.644887 run osmo-stp_10.42.42.5(pid=15609): stdout: | (launched: 2022-12-13_23:55:18.310415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:19.772222 run osmo-stp_10.42.42.5(pid=15609): stderr: | [0;m[38;5;43m20221213235518479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235518479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235518479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235518479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235518482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235518482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235518482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:19.899774 run osmo-stp_10.42.42.5(pid=15609): stdout: | (launched: 2022-12-13_23:55:18.310415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:20.020802 run osmo-stp_10.42.42.5(pid=15609): stderr: | [0;m[38;5;43m20221213235518479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235518479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235518479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235518479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235518482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235518482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235518482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:20.164885 run patchelf(pid=15612): Terminating (SIGINT) 23:55:20.331900 run patchelf(pid=15612): Terminated: ok {rc=0} 23:55:20.452241 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15609): Process ended prematurely: osmo-stp_10.42.42.5(pid=15609) [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15609)] [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 23:55:20.461609 tst iperf3.py:8: Test FAILED (7.3 sec) 23:55:20.488263 run osmo-hlr_10.42.42.2(pid=15606): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15606)] 23:55:20.535402 run osmo-hlr_10.42.42.2(pid=15606): stdout: | (launched: 2022-12-13_23:55:17.375212) 23:55:20.584485 run osmo-hlr_10.42.42.2(pid=15606): stderr: | [0;m[1;31m20221213235517554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235517554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235517554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235517554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235517554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235517554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235517567 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235517575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235517575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235517575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:20.633897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15601): Terminating (SIGTERM) 23:55:20.673429 run iperf3-srv_10.42.42.10(pid=15602): Terminating (SIGTERM) 23:55:20.712735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15605): Terminating (SIGTERM) 23:55:20.752656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15608): Terminating (SIGTERM) 23:55:20.792466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15611): Terminating (SIGTERM) 23:55:20.832369 --- ParallelTerminationStrategy: PID 15601 died... 23:55:20.851358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15601): Terminated: ok {rc=0} 23:55:20.895139 --- ParallelTerminationStrategy: PID 15602 died... 23:55:20.913578 run iperf3-srv_10.42.42.10(pid=15602): Terminated {rc=256} 23:55:20.957106 --- ParallelTerminationStrategy: PID 15605 died... 23:55:20.975604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15605): Terminated: ok {rc=0} 23:55:21.019290 --- ParallelTerminationStrategy: PID 15608 died... 23:55:21.037806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15608): Terminated: ok {rc=0} 23:55:21.081422 --- ParallelTerminationStrategy: PID 15611 died... 23:55:21.100030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15611): Terminated: ok {rc=0} 23:55:21.183526 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 23:55:22.332026 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.344261 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:55:22.402066 tst iperf3m4.py: using LAC 37112 23:55:22.528784 tst iperf3m4.py: using RAC 137 23:55:22.653391 tst iperf3m4.py: using CellId 37112 23:55:22.776030 tst iperf3m4.py: using BVCI 37113 23:55:22.891211 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.902931 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.914446 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.926048 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.937971 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.949733 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.961624 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.973410 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.985410 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:23.104668 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:23.225811 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:23.341420 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:23.462271 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:55:23.676773 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:23.993492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15613): Launched 23:55:24.266969 run iperf3-srv_10.42.42.10(pid=15614): Launched 23:55:24.385808 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:55:24.599061 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:24.915933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15615): Launched 23:55:25.190752 run iperf3-srv_10.42.42.10(pid=15616): Launched 23:55:25.308895 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:55:25.522196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:25.838689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15617): Launched 23:55:26.112733 run iperf3-srv_10.42.42.10(pid=15618): Launched 23:55:26.231269 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:55:26.444347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:26.762076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15619): Launched 23:55:27.036686 run iperf3-srv_10.42.42.10(pid=15620): Launched 23:55:27.155034 tst iperf3m4.py:8: start network... 23:55:27.368005 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:27.860592 run create_hlr_db(pid=15621): Launched 23:55:27.981870 bus /gobi_6: Setting Powered False 23:55:29.045048 run create_hlr_db(pid=15621): Terminated: ok {rc=0} 23:55:29.486539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15623): Launched 23:55:29.803960 run osmo-hlr_10.42.42.2(pid=15624): Launched 23:55:29.925471 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:30.476160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15626): Launched 23:55:30.792912 run osmo-stp_10.42.42.5(pid=15627): Launched 23:55:30.961754 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:31.714789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15629): Launched 23:55:31.842999 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:32.111633 run patchelf(pid=15630): Launched 23:55:32.291285 run osmo-stp_10.42.42.5(pid=15627): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15627)] 23:55:32.419024 run osmo-stp_10.42.42.5(pid=15627): stdout: | (launched: 2022-12-13_23:55:30.735407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:32.547101 run osmo-stp_10.42.42.5(pid=15627): stderr: | [0;m[38;5;43m20221213235531054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235531054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235531054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235531054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235531055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235531055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235531055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:32.674524 run osmo-stp_10.42.42.5(pid=15627): stdout: | (launched: 2022-12-13_23:55:30.735407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:32.796234 run osmo-stp_10.42.42.5(pid=15627): stderr: | [0;m[38;5;43m20221213235531054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235531054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235531054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235531054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235531055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235531055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235531055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:32.940238 run patchelf(pid=15630): Terminating (SIGINT) 23:55:33.107518 run patchelf(pid=15630): Terminated: ok {rc=0} 23:55:33.227825 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15627): Process ended prematurely: osmo-stp_10.42.42.5(pid=15627) [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15627)] [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 23:55:33.237369 tst iperf3m4.py:8: Test FAILED (10.9 sec) 23:55:33.264609 run osmo-hlr_10.42.42.2(pid=15624): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15624)] 23:55:33.312520 run osmo-hlr_10.42.42.2(pid=15624): stdout: | (launched: 2022-12-13_23:55:29.746235) 23:55:33.361903 run osmo-hlr_10.42.42.2(pid=15624): stderr: | [0;m[1;31m20221213235529945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235529945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235529945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235529945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235529945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235529945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235529958 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235529966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235529966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235529966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:33.411311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15613): Terminating (SIGTERM) 23:55:33.451073 run iperf3-srv_10.42.42.10(pid=15614): Terminating (SIGTERM) 23:55:33.490457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15615): Terminating (SIGTERM) 23:55:33.530474 run iperf3-srv_10.42.42.10(pid=15616): Terminating (SIGTERM) 23:55:33.569731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15617): Terminating (SIGTERM) 23:55:33.609033 run iperf3-srv_10.42.42.10(pid=15618): Terminating (SIGTERM) 23:55:33.648259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15619): Terminating (SIGTERM) 23:55:33.687571 run iperf3-srv_10.42.42.10(pid=15620): Terminating (SIGTERM) 23:55:33.726843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15623): Terminating (SIGTERM) 23:55:33.766404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15626): Terminating (SIGTERM) 23:55:33.805754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15629): Terminating (SIGTERM) 23:55:33.845427 --- ParallelTerminationStrategy: PID 15613 died... 23:55:33.864321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15613): Terminated: ok {rc=0} 23:55:33.908458 --- ParallelTerminationStrategy: PID 15614 died... 23:55:33.926959 run iperf3-srv_10.42.42.10(pid=15614): Terminated {rc=256} 23:55:33.970601 --- ParallelTerminationStrategy: PID 15615 died... 23:55:33.989221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15615): Terminated: ok {rc=0} 23:55:34.032907 --- ParallelTerminationStrategy: PID 15616 died... 23:55:34.051830 run iperf3-srv_10.42.42.10(pid=15616): Terminated {rc=256} 23:55:34.095579 --- ParallelTerminationStrategy: PID 15617 died... 23:55:34.114183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15617): Terminated: ok {rc=0} 23:55:34.157955 --- ParallelTerminationStrategy: PID 15618 died... 23:55:34.176446 run iperf3-srv_10.42.42.10(pid=15618): Terminated {rc=256} 23:55:34.219900 --- ParallelTerminationStrategy: PID 15619 died... 23:55:34.238581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15619): Terminated: ok {rc=0} 23:55:34.282317 --- ParallelTerminationStrategy: PID 15620 died... 23:55:34.301243 run iperf3-srv_10.42.42.10(pid=15620): Terminated {rc=256} 23:55:34.344876 --- ParallelTerminationStrategy: PID 15623 died... 23:55:34.364107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15623): Terminated: ok {rc=0} 23:55:34.407946 --- ParallelTerminationStrategy: PID 15626 died... 23:55:34.426510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15626): Terminated: ok {rc=0} 23:55:34.470153 --- ParallelTerminationStrategy: PID 15629 died... 23:55:34.488789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15629): Terminated: ok {rc=0} 23:55:34.571198 bus /gobi_4: Setting Powered False 23:55:35.666393 bus /gobi_4: Setting Powered False 23:55:36.779214 bus /gobi_1: Setting Powered False 23:55:37.875891 bus /gobi_1: Setting Powered False 23:55:38.990720 bus /gobi_0: Setting Powered False 23:55:40.088838 bus /gobi_0: Setting Powered False 23:55:41.202614 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 23:55:42.303998 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:42.315749 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:55:42.367150 tst ping.py: using LAC 37113 23:55:42.490887 tst ping.py: using RAC 138 23:55:42.614307 tst ping.py: using CellId 37113 23:55:42.735871 tst ping.py: using BVCI 37114 23:55:42.849823 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:42.861750 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:42.873289 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:42.884741 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:42.896562 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:42.908418 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:42.920463 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:42.932276 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:43.046565 tst ping.py:19: start network... 23:55:43.241275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:43.692144 run create_hlr_db(pid=15631): Launched 23:55:43.811254 bus /gobi_6: Setting Powered False 23:55:44.869403 run create_hlr_db(pid=15631): Terminated: ok {rc=0} 23:55:45.294760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15633): Launched 23:55:45.604515 run osmo-hlr_10.42.42.2(pid=15634): Launched 23:55:45.723375 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:46.344311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15636): Launched 23:55:46.653085 run osmo-stp_10.42.42.5(pid=15637): Launched 23:55:46.869666 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:47.489462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15639): Launched 23:55:47.613107 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:47.860893 run patchelf(pid=15640): Launched 23:55:48.022932 run osmo-stp_10.42.42.5(pid=15637): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15637)] 23:55:48.146591 run osmo-stp_10.42.42.5(pid=15637): stdout: | (launched: 2022-12-13_23:55:46.590808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:48.271553 run osmo-stp_10.42.42.5(pid=15637): stderr: | [0;m[38;5;43m20221213235546908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235546908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235546908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235546921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235546922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235546922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235546922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:48.396863 run osmo-stp_10.42.42.5(pid=15637): stdout: | (launched: 2022-12-13_23:55:46.590808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:48.516633 run osmo-stp_10.42.42.5(pid=15637): stderr: | [0;m[38;5;43m20221213235546908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235546908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235546908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235546921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235546922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235546922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235546922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:48.657926 run patchelf(pid=15640): Terminating (SIGINT) 23:55:48.821155 run patchelf(pid=15640): Terminated: ok {rc=0} 23:55:48.938803 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15637): Process ended prematurely: osmo-stp_10.42.42.5(pid=15637) [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15637)] [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 23:55:48.947467 tst ping.py:22: Test FAILED (6.6 sec) 23:55:48.973715 run osmo-hlr_10.42.42.2(pid=15634): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15634)] 23:55:49.021101 run osmo-hlr_10.42.42.2(pid=15634): stdout: | (launched: 2022-12-13_23:55:45.547819) 23:55:49.069808 run osmo-hlr_10.42.42.2(pid=15634): stderr: | [0;m[1;31m20221213235545748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235545748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235545748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235545748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235545748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235545748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235545761 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235545769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235545769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235545769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:49.119167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15633): Terminating (SIGTERM) 23:55:49.158528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15636): Terminating (SIGTERM) 23:55:49.197812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15639): Terminating (SIGTERM) 23:55:49.237397 --- ParallelTerminationStrategy: PID 15633 died... 23:55:49.256405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15633): Terminated: ok {rc=0} 23:55:49.300003 --- ParallelTerminationStrategy: PID 15636 died... 23:55:49.318555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15636): Terminated: ok {rc=0} 23:55:49.362049 --- ParallelTerminationStrategy: PID 15639 died... 23:55:49.380532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15639): Terminated: ok {rc=0} 23:55:49.465975 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 23:55:50.552810 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:50.564776 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:55:50.618447 tst ping_idle_ping.py: using LAC 37114 23:55:50.734569 tst ping_idle_ping.py: using RAC 139 23:55:50.849923 tst ping_idle_ping.py: using CellId 37114 23:55:50.966194 tst ping_idle_ping.py: using BVCI 37115 23:55:51.073293 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.084803 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.095830 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.106822 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.118364 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.129976 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.141615 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.153137 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:51.271671 tst ping_idle_ping.py:24: start network... 23:55:51.482575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:51.967321 run create_hlr_db(pid=15646): Launched 23:55:52.086619 bus /gobi_6: Setting Powered False 23:55:53.148270 run create_hlr_db(pid=15646): Terminated: ok {rc=0} 23:55:53.569179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15648): Launched 23:55:53.861594 run osmo-hlr_10.42.42.2(pid=15649): Launched 23:55:53.973341 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:54.510874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15651): Launched 23:55:54.822304 run osmo-stp_10.42.42.5(pid=15652): Launched 23:55:54.941098 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:55.478729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15654): Launched 23:55:55.598368 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:55.862032 run patchelf(pid=15655): Launched 23:55:56.034718 run osmo-stp_10.42.42.5(pid=15652): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15652)] 23:55:56.167185 run osmo-stp_10.42.42.5(pid=15652): stdout: | (launched: 2022-12-13_23:55:54.765920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:56.300753 run osmo-stp_10.42.42.5(pid=15652): stderr: | [0;m[38;5;43m20221213235554956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235554956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235554957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235554957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235554957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235554958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235554958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:56.434547 run osmo-stp_10.42.42.5(pid=15652): stdout: | (launched: 2022-12-13_23:55:54.765920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:56.562899 run osmo-stp_10.42.42.5(pid=15652): stderr: | [0;m[38;5;43m20221213235554956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235554956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235554957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235554957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235554957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235554958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235554958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:56.715015 run patchelf(pid=15655): Terminating (SIGINT) 23:55:56.889603 run patchelf(pid=15655): Terminated: ok {rc=0} 23:55:57.015593 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15652): Process ended prematurely: osmo-stp_10.42.42.5(pid=15652) [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15652)] [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 23:55:57.025114 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:55:57.052700 run osmo-hlr_10.42.42.2(pid=15649): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15649)] 23:55:57.102904 run osmo-hlr_10.42.42.2(pid=15649): stdout: | (launched: 2022-12-13_23:55:53.808068) 23:55:57.154263 run osmo-hlr_10.42.42.2(pid=15649): stderr: | [0;m[1;31m20221213235553983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235553983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235553983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235553983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235553983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235553983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235553995 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235554003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235554004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235554004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:57.205998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15648): Terminating (SIGTERM) 23:55:57.247483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15651): Terminating (SIGTERM) 23:55:57.289091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15654): Terminating (SIGTERM) 23:55:57.330828 --- ParallelTerminationStrategy: PID 15648 died... 23:55:57.350954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15648): Terminated: ok {rc=0} 23:55:57.396917 --- ParallelTerminationStrategy: PID 15651 died... 23:55:57.416641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15651): Terminated: ok {rc=0} 23:55:57.462317 --- ParallelTerminationStrategy: PID 15654 died... 23:55:57.482087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15654): Terminated: ok {rc=0} 23:55:57.570288 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:55:58.883396 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:55:58.891445 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:55:58.924660 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:55:58.960649 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:55:59.013854 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:55:59.045914 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:55:59.080503 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:55:59.648926 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:55:59.654442 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:55:59.666160 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:55:59.734985 tst switch_tch_pdch.py: using LAC 37115 23:55:59.854753 tst switch_tch_pdch.py: using RAC 140 23:55:59.974584 tst switch_tch_pdch.py: using CellId 37115 23:56:00.095937 tst switch_tch_pdch.py: using BVCI 37116 23:56:00.208208 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:00.219828 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:00.231221 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:00.242737 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:00.254474 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:00.266122 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:00.277972 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:00.289790 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:56:00.405510 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:56:00.519514 tst switch_tch_pdch.py:51: start network... 23:56:00.715426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:01.226218 run create_hlr_db(pid=15659): Launched 23:56:01.379052 bus /gobi_6: Setting Powered False 23:56:02.437456 run create_hlr_db(pid=15659): Terminated: ok {rc=0} 23:56:02.846431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15661): Launched 23:56:03.138005 run osmo-hlr_10.42.42.2(pid=15662): Launched 23:56:03.247608 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:03.748696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15664): Launched 23:56:04.041759 run osmo-stp_10.42.42.5(pid=15665): Launched 23:56:04.152075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:56:04.654449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15667): Launched 23:56:04.765878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:56:05.012780 run patchelf(pid=15668): Launched 23:56:05.174704 run osmo-stp_10.42.42.5(pid=15665): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15665)] 23:56:05.298483 run osmo-stp_10.42.42.5(pid=15665): stdout: | (launched: 2022-12-13_23:56:03.988365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:05.423536 run osmo-stp_10.42.42.5(pid=15665): stderr: | [0;m[38;5;43m20221213235604157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235604157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235604157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235604158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235604158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235604158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235604158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:05.549062 run osmo-stp_10.42.42.5(pid=15665): stdout: | (launched: 2022-12-13_23:56:03.988365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:05.668634 run osmo-stp_10.42.42.5(pid=15665): stderr: | [0;m[38;5;43m20221213235604157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235604157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235604157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235604158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235604158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235604158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235604158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:05.811357 run patchelf(pid=15668): Terminating (SIGINT) 23:56:05.974804 run patchelf(pid=15668): Terminated: ok {rc=0} 23:56:06.092210 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15665): Process ended prematurely: osmo-stp_10.42.42.5(pid=15665) [trial-2396↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15665)] [trial-2396↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:56:06.101065 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 23:56:06.127373 run osmo-hlr_10.42.42.2(pid=15662): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15662)] 23:56:06.174974 run osmo-hlr_10.42.42.2(pid=15662): stdout: | (launched: 2022-12-13_23:56:03.084533) 23:56:06.224201 run osmo-hlr_10.42.42.2(pid=15662): stderr: | [0;m[1;31m20221213235603259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235603259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235603259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235603259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235603259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235603259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235603271 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235603280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235603280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235603280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:56:06.274217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15661): Terminating (SIGTERM) 23:56:06.314038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15664): Terminating (SIGTERM) 23:56:06.353874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15667): Terminating (SIGTERM) 23:56:06.393959 --- ParallelTerminationStrategy: PID 15661 died... 23:56:06.413169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15661): Terminated: ok {rc=0} 23:56:06.457075 --- ParallelTerminationStrategy: PID 15664 died... 23:56:06.475516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15664): Terminated: ok {rc=0} 23:56:06.519353 --- ParallelTerminationStrategy: PID 15667 died... 23:56:06.537981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15667): Terminated: ok {rc=0} 23:56:06.620833 bus /gobi_0: Setting Powered False 23:56:07.719295 bus /gobi_0: Setting Powered False 23:56:08.835785 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:56:10.089238 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:10.094990 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:56:10.126848 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:56:10.161203 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:56:10.212353 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:56:10.245550 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:56:10.280936 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:56:10.839886 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:56:10.845610 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:10.856879 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:56:10.926949 tst switch_tch_pdch.py: using LAC 37116 23:56:11.041844 tst switch_tch_pdch.py: using RAC 141 23:56:11.157628 tst switch_tch_pdch.py: using CellId 37116 23:56:11.278444 tst switch_tch_pdch.py: using BVCI 37117 23:56:11.391567 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:11.403131 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:11.414533 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:11.425857 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:11.437441 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:11.448891 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:11.460473 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:11.471918 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:56:11.590692 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:56:11.706849 tst switch_tch_pdch.py:51: start network... 23:56:11.902798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:12.328301 run create_hlr_db(pid=15672): Launched 23:56:12.448364 bus /gobi_6: Setting Powered False 23:56:13.507143 run create_hlr_db(pid=15672): Terminated: ok {rc=0} 23:56:13.908687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15674): Launched 23:56:14.219527 run osmo-hlr_10.42.42.2(pid=15675): Launched 23:56:14.338123 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:14.849407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15677): Launched 23:56:15.159991 run osmo-stp_10.42.42.5(pid=15678): Launched 23:56:15.278784 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:56:15.792017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15680): Launched 23:56:15.927425 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:56:16.209457 run patchelf(pid=15681): Launched 23:56:16.397651 run osmo-stp_10.42.42.5(pid=15678): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15678)] 23:56:16.532685 run osmo-stp_10.42.42.5(pid=15678): stdout: | (launched: 2022-12-13_23:56:15.103364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:16.670001 run osmo-stp_10.42.42.5(pid=15678): stderr: | [0;m[38;5;43m20221213235615294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235615294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235615294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235615295 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235615295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235615295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235615295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:16.806768 run osmo-stp_10.42.42.5(pid=15678): stdout: | (launched: 2022-12-13_23:56:15.103364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:16.938154 run osmo-stp_10.42.42.5(pid=15678): stderr: | [0;m[38;5;43m20221213235615294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235615294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235615294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235615295 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235615295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235615295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235615295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:17.092942 run patchelf(pid=15681): Terminating (SIGINT) 23:56:17.270918 run patchelf(pid=15681): Terminated: ok {rc=0} 23:56:17.397075 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15678): Process ended prematurely: osmo-stp_10.42.42.5(pid=15678) [trial-2396↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15678)] [trial-2396↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:56:17.406857 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 23:56:17.435053 run osmo-hlr_10.42.42.2(pid=15675): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15675)] 23:56:17.486289 run osmo-hlr_10.42.42.2(pid=15675): stdout: | (launched: 2022-12-13_23:56:14.163292) 23:56:17.538897 run osmo-hlr_10.42.42.2(pid=15675): stderr: | [0;m[1;31m20221213235614363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235614363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235614363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235614363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235614363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235614363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235614376 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235614386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235614386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235614386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:56:17.592441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15674): Terminating (SIGTERM) 23:56:17.634228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15677): Terminating (SIGTERM) 23:56:17.676870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15680): Terminating (SIGTERM) 23:56:17.719049 --- ParallelTerminationStrategy: PID 15674 died... 23:56:17.739213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15674): Terminated: ok {rc=0} 23:56:17.785583 --- ParallelTerminationStrategy: PID 15677 died... 23:56:17.805364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15677): Terminated: ok {rc=0} 23:56:17.851491 --- ParallelTerminationStrategy: PID 15680 died... 23:56:17.871432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15680): Terminated: ok {rc=0} 23:56:17.959245 bus /gobi_0: Setting Powered False 23:56:19.056783 bus /gobi_0: Setting Powered False 23:56:20.170836 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_sms:trx-lms --------------------------------------------------------------------- 23:56:21.421681 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:21.425979 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 23:56:21.459374 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 23:56:21.466939 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 23:56:21.524326 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 23:56:21.557904 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 23:56:21.564648 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 23:56:22.098234 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 23:56:22.103466 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 23:56:22.114228 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 23:56:22.161361 tst mo_mt_sms.py: using LAC 37117 23:56:22.276428 tst mo_mt_sms.py: using RAC 142 23:56:22.390484 tst mo_mt_sms.py: using CellId 37117 23:56:22.507112 tst mo_mt_sms.py: using BVCI 37118 23:56:22.611870 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 23:56:22.729355 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 23:56:22.842782 tst mo_mt_sms.py:9: start nitb and bts... 23:56:23.038727 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:56:23.631228 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15685): Launched 23:56:23.920561 run osmo-nitb_10.42.42.2(pid=15686): Launched 23:56:24.081742 run osmo-nitb_10.42.42.2(pid=15686): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15686)] 23:56:24.212551 run osmo-nitb_10.42.42.2(pid=15686): stdout: | (launched: 2022-12-13_23:56:23.867544) 23:56:24.346046 run osmo-nitb_10.42.42.2(pid=15686): stderr: | (launched: 2022-12-13_23:56:23.910707) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:56:24.478202 run osmo-nitb_10.42.42.2(pid=15686): stdout: | (launched: 2022-12-13_23:56:23.867544) 23:56:24.605285 run osmo-nitb_10.42.42.2(pid=15686): stderr: | (launched: 2022-12-13_23:56:23.910707) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15686): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15686) [trial-2396↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15686)] 23:56:25.029887 tst osmo-nitb_10.42.42.2(pid=15686): stdout: | (launched: 2022-12-13_23:56:23.867544) 23:56:25.147394 tst osmo-nitb_10.42.42.2(pid=15686): stderr: | (launched: 2022-12-13_23:56:23.910707) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:56:25.285916 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=15686): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15686) [trial-2396↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15686)] [trial-2396↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 23:56:25.294208 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 23:56:25.300557 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15685): Terminating (SIGTERM) 23:56:25.508137 --- ParallelTerminationStrategy: PID 15685 died... 23:56:25.529571 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15685): Terminated: ok {rc=0} 23:56:25.611686 bus /sierra_3: Setting Powered False 23:56:26.709299 bus /sierra_3: Setting Powered False 23:56:27.827480 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 sms:trx-lms --------------------------------------------------------------------- 23:56:29.026275 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:29.031109 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 23:56:29.064530 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 23:56:29.091131 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 23:56:29.142922 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 23:56:29.175965 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 23:56:29.202751 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 23:56:29.746779 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 23:56:29.752515 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:29.763584 tst sms:trx-lms: Using 1 x bts (candidates: 1) 23:56:29.810751 tst mo_mt_sms.py: using LAC 37118 23:56:29.926613 tst mo_mt_sms.py: using RAC 143 23:56:30.041826 tst mo_mt_sms.py: using CellId 37118 23:56:30.155183 tst mo_mt_sms.py: using BVCI 37119 23:56:30.259626 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:30.270056 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:30.280297 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:30.290567 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:30.300677 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:30.311058 tst sms:trx-lms: Using 1 x modem (candidates: 2) 23:56:30.429672 tst sms:trx-lms: Using 1 x modem (candidates: 2) 23:56:30.547841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:31.041839 run create_hlr_db(pid=15690): Launched 23:56:31.187824 bus /sierra_2: Setting Powered False 23:56:32.248793 run create_hlr_db(pid=15690): Terminated: ok {rc=0} 23:56:32.685439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15692): Launched 23:56:32.994572 run osmo-hlr_10.42.42.2(pid=15693): Launched 23:56:33.112755 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:33.649051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15695): Launched 23:56:33.957276 run osmo-stp_10.42.42.5(pid=15696): Launched 23:56:34.075660 run osmo-msc_10.42.42.6: Starting osmo-msc 23:56:34.637645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15698): Launched 23:56:34.947000 run osmo-msc_10.42.42.6(pid=15699): Launched 23:56:35.119403 run osmo-stp_10.42.42.5(pid=15696): ERR: Terminated: ERROR {rc=1} [trial-2396↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15696)] 23:56:35.251245 run osmo-stp_10.42.42.5(pid=15696): stdout: | (launched: 2022-12-13_23:56:33.901146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:35.384374 run osmo-stp_10.42.42.5(pid=15696): stderr: | [0;m[38;5;43m20221213235634092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235634093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235634093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235634093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235634094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235634094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235634094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:35.515603 run osmo-stp_10.42.42.5(pid=15696): stdout: | (launched: 2022-12-13_23:56:33.901146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:35.639818 run osmo-stp_10.42.42.5(pid=15696): stderr: | [0;m[38;5;43m20221213235634092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235634093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235634093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235634093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235634094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235634094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235634094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:35.787401 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=15696): Process ended prematurely: osmo-stp_10.42.42.5(pid=15696) [trial-2396↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15696)] [trial-2396↪sms:trx-lms↪mo_mt_sms.py:16] 23:56:35.796030 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 23:56:35.822885 run osmo-hlr_10.42.42.2(pid=15693): ERR: Terminated: ERROR {rc=237} [trial-2396↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15693)] 23:56:35.872849 run osmo-hlr_10.42.42.2(pid=15693): stdout: | (launched: 2022-12-13_23:56:32.938366) 23:56:35.925128 run osmo-hlr_10.42.42.2(pid=15693): stderr: | [0;m[1;31m20221213235633134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235633134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235633134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235633134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235633134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235633134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235633146 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235633154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235633154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235633154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:56:35.996824 run osmo-msc_10.42.42.6(pid=15699): ERR: Terminated: ERROR {rc=2} [trial-2396↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15699)] 23:56:36.046293 run osmo-msc_10.42.42.6(pid=15699): stdout: | (launched: 2022-12-13_23:56:34.890819) 23:56:36.097763 run osmo-msc_10.42.42.6(pid=15699): stderr: | [0;m[38;5;43m20221213235635208 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235635208 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff32f841c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235635208 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235635208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235635208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235635209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235635210 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235635211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235635211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235635211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:56:36.149626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15692): Terminating (SIGTERM) 23:56:36.190878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15695): Terminating (SIGTERM) 23:56:36.232306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15698): Terminating (SIGTERM) 23:56:36.273973 --- ParallelTerminationStrategy: PID 15692 died... 23:56:36.294056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15692): Terminated: ok {rc=0} 23:56:36.340066 --- ParallelTerminationStrategy: PID 15695 died... 23:56:36.359614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15695): Terminated: ok {rc=0} 23:56:36.405236 --- ParallelTerminationStrategy: PID 15698 died... 23:56:36.424838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15698): Terminated: ok {rc=0} 23:56:36.512330 bus /sierra_3: Setting Powered False 23:56:37.608480 bus /sierra_3: Setting Powered False 23:56:38.724015 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_ussd:trx-lms --------------------------------------------------------------------- 23:56:39.956660 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:39.961074 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 23:56:39.994552 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 23:56:40.002109 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 23:56:40.037869 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 23:56:40.071543 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 23:56:40.078461 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 23:56:40.598723 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2396 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 23:56:40.604204 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 23:56:40.615364 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 23:56:40.665201 tst assert_extension.py: using LAC 37119 23:56:40.787593 tst assert_extension.py: using RAC 144 23:56:40.909254 tst assert_extension.py: using CellId 37119 23:56:41.032385 tst assert_extension.py: using BVCI 37120 23:56:41.146238 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 23:56:41.260428 tst assert_extension.py:10: start nitb and bts... 23:56:41.454698 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:56:42.049764 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15704): Launched 23:56:42.339531 run osmo-nitb_10.42.42.2(pid=15705): Launched 23:56:42.500111 run osmo-nitb_10.42.42.2(pid=15705): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15705)] 23:56:42.630523 run osmo-nitb_10.42.42.2(pid=15705): stdout: | (launched: 2022-12-13_23:56:42.286663) 23:56:42.762925 run osmo-nitb_10.42.42.2(pid=15705): stderr: | (launched: 2022-12-13_23:56:42.329920) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:56:42.895107 run osmo-nitb_10.42.42.2(pid=15705): stdout: | (launched: 2022-12-13_23:56:42.286663) 23:56:43.022002 run osmo-nitb_10.42.42.2(pid=15705): stderr: | (launched: 2022-12-13_23:56:42.329920) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15705): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15705) [trial-2396↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15705)] 23:56:43.449237 tst osmo-nitb_10.42.42.2(pid=15705): stdout: | (launched: 2022-12-13_23:56:42.286663) 23:56:43.566559 tst osmo-nitb_10.42.42.2(pid=15705): stderr: | (launched: 2022-12-13_23:56:42.329920) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:56:43.704770 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15705): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15705) [trial-2396↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15705)] [trial-2396↪nitb_ussd:trx-lms↪assert_extension.py:12] 23:56:43.713343 tst assert_extension.py:12: Test FAILED (3.1 sec) 23:56:43.719700 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15704): Terminating (SIGTERM) 23:56:43.927778 --- ParallelTerminationStrategy: PID 15704 died... 23:56:43.948300 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15704): Terminated: ok {rc=0} 23:56:44.033724 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 ussd:trx-lms --------------------------------------------------------------------- 23:56:45.211845 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:45.216383 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 23:56:45.248843 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 23:56:45.276588 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 23:56:45.311880 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 23:56:45.345148 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 23:56:45.371988 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 23:56:45.903825 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2396 ussd:trx-lms assert_extension.py ---------------------------------------------- 23:56:45.913305 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:45.925893 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 23:56:45.977990 tst assert_extension.py: using LAC 37120 23:56:46.107294 tst assert_extension.py: using RAC 145 23:56:46.241504 tst assert_extension.py: using CellId 37120 23:56:46.357788 tst assert_extension.py: using BVCI 37121 23:56:46.475502 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:46.488571 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:46.500445 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:46.512249 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:46.525128 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:46.537755 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 23:56:46.659501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:47.156819 run create_hlr_db(pid=15709): Launched 23:56:47.307467 bus /sierra_2: Setting Powered False 23:56:48.370542 run create_hlr_db(pid=15709): Terminated: ok {rc=0} 23:56:48.788919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15711): Launched 23:56:49.079717 run osmo-hlr_10.42.42.2(pid=15712): Launched 23:56:49.190872 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:49.709962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15714): Launched 23:56:50.000333 run osmo-stp_10.42.42.5(pid=15715): Launched 23:56:50.111140 run osmo-msc_10.42.42.6: Starting osmo-msc 23:56:50.638222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15717): Launched 23:56:50.928818 run osmo-msc_10.42.42.6(pid=15718): Launched 23:56:51.091534 run osmo-stp_10.42.42.5(pid=15715): ERR: Terminated: ERROR {rc=1} [trial-2396↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15715)] 23:56:51.215254 run osmo-stp_10.42.42.5(pid=15715): stdout: | (launched: 2022-12-13_23:56:49.946735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:51.339036 run osmo-stp_10.42.42.5(pid=15715): stderr: | [0;m[38;5;43m20221213235650115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235650115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235650115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235650116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235650118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235650118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235650118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:51.460550 run osmo-stp_10.42.42.5(pid=15715): stdout: | (launched: 2022-12-13_23:56:49.946735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:51.576772 run osmo-stp_10.42.42.5(pid=15715): stderr: | [0;m[38;5;43m20221213235650115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235650115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235650115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235650116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235650118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235650118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235650118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:51.715494 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15715): Process ended prematurely: osmo-stp_10.42.42.5(pid=15715) [trial-2396↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15715)] [trial-2396↪ussd:trx-lms↪assert_extension.py:17] 23:56:51.723748 tst assert_extension.py:17: Test FAILED (5.8 sec) 23:56:51.749465 run osmo-hlr_10.42.42.2(pid=15712): ERR: Terminated: ERROR {rc=237} [trial-2396↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15712)] 23:56:51.796640 run osmo-hlr_10.42.42.2(pid=15712): stdout: | (launched: 2022-12-13_23:56:49.026824) 23:56:51.845690 run osmo-hlr_10.42.42.2(pid=15712): stderr: | [0;m[1;31m20221213235649203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235649203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235649203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235649203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235649203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235649203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235649215 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235649223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235649224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235649224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:56:51.913543 run osmo-msc_10.42.42.6(pid=15718): ERR: Terminated: ERROR {rc=2} [trial-2396↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15718)] 23:56:51.961623 run osmo-msc_10.42.42.6(pid=15718): stdout: | (launched: 2022-12-13_23:56:50.875648) 23:56:52.010421 run osmo-msc_10.42.42.6(pid=15718): stderr: | [0;m[38;5;43m20221213235651143 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235651143 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4344f70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235651143 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235651143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235651143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235651143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235651145 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235651146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235651146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235651146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:56:52.059417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15711): Terminating (SIGTERM) 23:56:52.098728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15714): Terminating (SIGTERM) 23:56:52.137962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15717): Terminating (SIGTERM) 23:56:52.177835 --- ParallelTerminationStrategy: PID 15711 died... 23:56:52.197055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15711): Terminated: ok {rc=0} 23:56:52.240669 --- ParallelTerminationStrategy: PID 15714 died... 23:56:52.259321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15714): Terminated: ok {rc=0} 23:56:52.302620 --- ParallelTerminationStrategy: PID 15717 died... 23:56:52.321167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15717): Terminated: ok {rc=0} 23:56:52.402998 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:56:53.612796 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:53.620102 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:56:53.654836 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:56:53.682116 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:56:53.735229 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:56:53.768519 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:56:53.795911 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:56:54.346894 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:56:54.398129 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:54.409379 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:56:54.480004 tst mo_mt_call.py: using LAC 37121 23:56:54.596746 tst mo_mt_call.py: using RAC 146 23:56:54.714303 tst mo_mt_call.py: using CellId 37121 23:56:54.832664 tst mo_mt_call.py: using BVCI 37122 23:56:54.939874 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:54.950944 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:54.962557 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:54.973473 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:54.984833 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:54.996279 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:56:55.116539 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:56:55.233068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:55.692649 run create_hlr_db(pid=15723): Launched 23:56:55.813913 bus /sierra_2: Setting Powered False 23:56:56.872455 run create_hlr_db(pid=15723): Terminated: ok {rc=0} 23:56:57.285975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15725): Launched 23:56:57.582187 run osmo-hlr_10.42.42.2(pid=15726): Launched 23:56:57.695495 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:58.203952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15728): Launched 23:56:58.499905 run osmo-stp_10.42.42.5(pid=15729): Launched 23:56:58.612794 run osmo-msc_10.42.42.6: Starting osmo-msc 23:56:59.148663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15731): Launched 23:56:59.444845 run osmo-msc_10.42.42.6(pid=15732): Launched 23:56:59.610826 run osmo-stp_10.42.42.5(pid=15729): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15729)] 23:56:59.736000 run osmo-stp_10.42.42.5(pid=15729): stdout: | (launched: 2022-12-13_23:56:58.445549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:59.862199 run osmo-stp_10.42.42.5(pid=15729): stderr: | [0;m[38;5;43m20221213235658617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235658617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235658617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235658617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235658618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235658618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235658618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:59.985268 run osmo-stp_10.42.42.5(pid=15729): stdout: | (launched: 2022-12-13_23:56:58.445549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:00.104222 run osmo-stp_10.42.42.5(pid=15729): stderr: | [0;m[38;5;43m20221213235658617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235658617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235658617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235658617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235658618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235658618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235658618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:00.245686 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15729): Process ended prematurely: osmo-stp_10.42.42.5(pid=15729) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15729)] [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:57:00.254558 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 23:57:00.280737 run osmo-hlr_10.42.42.2(pid=15726): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15726)] 23:57:00.328542 run osmo-hlr_10.42.42.2(pid=15726): stdout: | (launched: 2022-12-13_23:56:57.527853) 23:57:00.377510 run osmo-hlr_10.42.42.2(pid=15726): stderr: | [0;m[1;31m20221213235657704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235657704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235657704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235657704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235657705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235657705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235657717 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235657725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235657726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235657726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:00.445741 run osmo-msc_10.42.42.6(pid=15732): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15732)] 23:57:00.492922 run osmo-msc_10.42.42.6(pid=15732): stdout: | (launched: 2022-12-13_23:56:59.390633) 23:57:00.541891 run osmo-msc_10.42.42.6(pid=15732): stderr: | [0;m[38;5;43m20221213235659663 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235659663 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fadd5cb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235659663 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235659663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235659663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235659664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235659665 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235659666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235659666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235659666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:00.590888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15725): Terminating (SIGTERM) 23:57:00.629981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15728): Terminating (SIGTERM) 23:57:00.669111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15731): Terminating (SIGTERM) 23:57:00.708538 --- ParallelTerminationStrategy: PID 15725 died... 23:57:00.727572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15725): Terminated: ok {rc=0} 23:57:00.771100 --- ParallelTerminationStrategy: PID 15728 died... 23:57:00.789555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15728): Terminated: ok {rc=0} 23:57:00.838428 --- ParallelTerminationStrategy: PID 15731 died... 23:57:00.860864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15731): Terminated: ok {rc=0} 23:57:00.967076 bus /sierra_3: Setting Powered False 23:57:02.072580 bus /sierra_3: Setting Powered False 23:57:03.197396 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:57:04.339919 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:04.351587 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:57:04.421089 tst mo_mt_call_osmux.py: using LAC 37122 23:57:04.537580 tst mo_mt_call_osmux.py: using RAC 147 23:57:04.664366 tst mo_mt_call_osmux.py: using CellId 37122 23:57:04.789643 tst mo_mt_call_osmux.py: using BVCI 37123 23:57:04.905022 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:04.916559 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:04.928035 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:04.939535 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:04.951152 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:04.962758 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:57:05.081326 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:57:05.202430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:05.662092 run create_hlr_db(pid=15734): Launched 23:57:05.783786 bus /sierra_2: Setting Powered False 23:57:06.844095 run create_hlr_db(pid=15734): Terminated: ok {rc=0} 23:57:07.276273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15736): Launched 23:57:07.593813 run osmo-hlr_10.42.42.2(pid=15737): Launched 23:57:07.715060 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:08.262114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15739): Launched 23:57:08.578548 run osmo-stp_10.42.42.5(pid=15740): Launched 23:57:08.700632 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:09.272413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15742): Launched 23:57:09.589109 run osmo-msc_10.42.42.6(pid=15743): Launched 23:57:09.766235 run osmo-stp_10.42.42.5(pid=15740): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15740)] 23:57:09.900186 run osmo-stp_10.42.42.5(pid=15740): stdout: | (launched: 2022-12-13_23:57:08.521292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:10.035268 run osmo-stp_10.42.42.5(pid=15740): stderr: | [0;m[38;5;43m20221213235708712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235708712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235708712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235708713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235708713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235708713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235708713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:10.169048 run osmo-stp_10.42.42.5(pid=15740): stdout: | (launched: 2022-12-13_23:57:08.521292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:10.295235 run osmo-stp_10.42.42.5(pid=15740): stderr: | [0;m[38;5;43m20221213235708712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235708712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235708712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235708713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235708713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235708713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235708713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:10.446638 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15740): Process ended prematurely: osmo-stp_10.42.42.5(pid=15740) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15740)] [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:57:10.455975 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:57:10.483451 run osmo-hlr_10.42.42.2(pid=15737): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15737)] 23:57:10.533796 run osmo-hlr_10.42.42.2(pid=15737): stdout: | (launched: 2022-12-13_23:57:07.536453) 23:57:10.585527 run osmo-hlr_10.42.42.2(pid=15737): stderr: | [0;m[1;31m20221213235707735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235707735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235707735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235707735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235707735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235707735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235707748 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235707756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235707756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235707757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:10.658157 run osmo-msc_10.42.42.6(pid=15743): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15743)] 23:57:10.707716 run osmo-msc_10.42.42.6(pid=15743): stdout: | (launched: 2022-12-13_23:57:09.531772) 23:57:10.759414 run osmo-msc_10.42.42.6(pid=15743): stderr: | [0;m[38;5;43m20221213235709849 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235709849 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f26998d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235709849 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235709849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235709849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235709850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235709851 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235709852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235709852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235709852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:10.811247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15736): Terminating (SIGTERM) 23:57:10.852721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15739): Terminating (SIGTERM) 23:57:10.894603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15742): Terminating (SIGTERM) 23:57:10.936318 --- ParallelTerminationStrategy: PID 15736 died... 23:57:10.956539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15736): Terminated: ok {rc=0} 23:57:11.002545 --- ParallelTerminationStrategy: PID 15739 died... 23:57:11.022282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15739): Terminated: ok {rc=0} 23:57:11.068007 --- ParallelTerminationStrategy: PID 15742 died... 23:57:11.087717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15742): Terminated: ok {rc=0} 23:57:11.175169 bus /sierra_3: Setting Powered False 23:57:12.273942 bus /sierra_3: Setting Powered False 23:57:13.390041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:57:14.642680 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:57:14.650016 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:57:14.683749 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:57:14.712528 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:57:14.767346 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:57:14.800066 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:57:14.826368 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:57:15.374991 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:57:15.422737 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:15.433962 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:57:15.503549 tst mo_mt_call.py: using LAC 37123 23:57:15.622144 tst mo_mt_call.py: using RAC 148 23:57:15.738704 tst mo_mt_call.py: using CellId 37123 23:57:15.883101 tst mo_mt_call.py: using BVCI 37124 23:57:16.001895 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:16.014869 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:16.026834 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:16.038719 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:16.050874 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:16.062601 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:57:16.178501 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:57:16.294602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:16.808327 run create_hlr_db(pid=15749): Launched 23:57:16.962800 bus /sierra_2: Setting Powered False 23:57:18.022338 run create_hlr_db(pid=15749): Terminated: ok {rc=0} 23:57:18.438312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15751): Launched 23:57:18.735623 run osmo-hlr_10.42.42.2(pid=15752): Launched 23:57:18.848898 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:19.374116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15754): Launched 23:57:19.669650 run osmo-stp_10.42.42.5(pid=15755): Launched 23:57:19.781913 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:20.317357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15757): Launched 23:57:20.614591 run osmo-msc_10.42.42.6(pid=15758): Launched 23:57:20.779695 run osmo-stp_10.42.42.5(pid=15755): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15755)] 23:57:20.904361 run osmo-stp_10.42.42.5(pid=15755): stdout: | (launched: 2022-12-13_23:57:19.615296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:21.029614 run osmo-stp_10.42.42.5(pid=15755): stderr: | [0;m[38;5;43m20221213235719783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235719783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235719784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235719784 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235719784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235719785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235719785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:21.152790 run osmo-stp_10.42.42.5(pid=15755): stdout: | (launched: 2022-12-13_23:57:19.615296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:21.270749 run osmo-stp_10.42.42.5(pid=15755): stderr: | [0;m[38;5;43m20221213235719783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235719783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235719784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235719784 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235719784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235719785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235719785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:21.411900 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15755): Process ended prematurely: osmo-stp_10.42.42.5(pid=15755) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15755)] [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:57:21.420763 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:57:21.447043 run osmo-hlr_10.42.42.2(pid=15752): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15752)] 23:57:21.494601 run osmo-hlr_10.42.42.2(pid=15752): stdout: | (launched: 2022-12-13_23:57:18.681397) 23:57:21.543478 run osmo-hlr_10.42.42.2(pid=15752): stderr: | [0;m[1;31m20221213235718859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235718859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235718859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235718859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235718859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235718859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235718871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235718880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235718880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235718880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:21.611514 run osmo-msc_10.42.42.6(pid=15758): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15758)] 23:57:21.658706 run osmo-msc_10.42.42.6(pid=15758): stdout: | (launched: 2022-12-13_23:57:20.560546) 23:57:21.707306 run osmo-msc_10.42.42.6(pid=15758): stderr: | [0;m[38;5;43m20221213235720831 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235720831 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff34a6dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235720831 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235720831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235720831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235720831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235720833 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235720833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235720834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235720834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:21.756384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15751): Terminating (SIGTERM) 23:57:21.795652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15754): Terminating (SIGTERM) 23:57:21.834870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15757): Terminating (SIGTERM) 23:57:21.874115 --- ParallelTerminationStrategy: PID 15751 died... 23:57:21.893091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15751): Terminated: ok {rc=0} 23:57:21.936611 --- ParallelTerminationStrategy: PID 15754 died... 23:57:21.955119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15754): Terminated: ok {rc=0} 23:57:21.998285 --- ParallelTerminationStrategy: PID 15757 died... 23:57:22.016659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15757): Terminated: ok {rc=0} 23:57:22.099732 bus /sierra_3: Setting Powered False 23:57:23.194359 bus /sierra_3: Setting Powered False 23:57:24.308851 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:57:25.453711 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:25.465419 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:57:25.535653 tst mo_mt_call_osmux.py: using LAC 37124 23:57:25.656785 tst mo_mt_call_osmux.py: using RAC 149 23:57:25.774254 tst mo_mt_call_osmux.py: using CellId 37124 23:57:25.890389 tst mo_mt_call_osmux.py: using BVCI 37125 23:57:25.997258 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:26.008333 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:26.019376 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:26.030425 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:26.041296 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:26.052262 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:57:26.167774 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:57:26.285510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:26.777306 run create_hlr_db(pid=15760): Launched 23:57:26.899487 bus /sierra_2: Setting Powered False 23:57:27.962278 run create_hlr_db(pid=15760): Terminated: ok {rc=0} 23:57:28.387030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15762): Launched 23:57:28.685477 run osmo-hlr_10.42.42.2(pid=15763): Launched 23:57:28.798459 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:29.325889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15765): Launched 23:57:29.622618 run osmo-stp_10.42.42.5(pid=15766): Launched 23:57:29.735141 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:30.273552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15768): Launched 23:57:30.571101 run osmo-msc_10.42.42.6(pid=15769): Launched 23:57:30.736432 run osmo-stp_10.42.42.5(pid=15766): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15766)] 23:57:30.895636 run osmo-stp_10.42.42.5(pid=15766): stdout: | (launched: 2022-12-13_23:57:29.568169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:31.094072 run osmo-stp_10.42.42.5(pid=15766): stderr: | [0;m[38;5;43m20221213235729739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235729739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235729739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235729740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235729740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235729740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235729741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:31.221693 run osmo-stp_10.42.42.5(pid=15766): stdout: | (launched: 2022-12-13_23:57:29.568169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:31.344219 run osmo-stp_10.42.42.5(pid=15766): stderr: | [0;m[38;5;43m20221213235729739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235729739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235729739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235729740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235729740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235729740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235729741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:31.489993 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15766): Process ended prematurely: osmo-stp_10.42.42.5(pid=15766) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15766)] [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:57:31.499535 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:57:31.527291 run osmo-hlr_10.42.42.2(pid=15763): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15763)] 23:57:31.576070 run osmo-hlr_10.42.42.2(pid=15763): stdout: | (launched: 2022-12-13_23:57:28.630710) 23:57:31.627090 run osmo-hlr_10.42.42.2(pid=15763): stderr: | [0;m[1;31m20221213235728808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235728808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235728808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235728808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235728808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235728808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235728820 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235728829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235728829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235728829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:31.698041 run osmo-msc_10.42.42.6(pid=15769): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15769)] 23:57:31.746955 run osmo-msc_10.42.42.6(pid=15769): stdout: | (launched: 2022-12-13_23:57:30.516933) 23:57:31.797459 run osmo-msc_10.42.42.6(pid=15769): stderr: | [0;m[38;5;43m20221213235730789 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235730789 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2ee3821c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235730789 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235730789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235730790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235730790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235730791 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235730792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235730792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235730792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:31.850101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15762): Terminating (SIGTERM) 23:57:31.891434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15765): Terminating (SIGTERM) 23:57:31.932302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15768): Terminating (SIGTERM) 23:57:31.973394 --- ParallelTerminationStrategy: PID 15762 died... 23:57:31.993448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15762): Terminated: ok {rc=0} 23:57:32.038585 --- ParallelTerminationStrategy: PID 15765 died... 23:57:32.058182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15765): Terminated: ok {rc=0} 23:57:32.103375 --- ParallelTerminationStrategy: PID 15768 died... 23:57:32.123395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15768): Terminated: ok {rc=0} 23:57:32.209287 bus /sierra_3: Setting Powered False 23:57:33.308011 bus /sierra_3: Setting Powered False 23:57:34.426374 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:57:35.674242 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:57:35.680864 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:57:35.713495 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:57:35.740058 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:57:35.790738 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:57:35.823767 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:57:35.851193 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:57:36.401033 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:57:36.449268 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:36.460401 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:57:36.529522 tst mo_mt_call.py: using LAC 37125 23:57:36.648477 tst mo_mt_call.py: using RAC 150 23:57:36.764658 tst mo_mt_call.py: using CellId 37125 23:57:36.880520 tst mo_mt_call.py: using BVCI 37126 23:57:36.987765 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:36.998990 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:37.010113 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:37.021081 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:37.032051 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:37.043104 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:57:37.162116 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:57:37.281247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:37.740116 run create_hlr_db(pid=15774): Launched 23:57:37.861430 bus /sierra_2: Setting Powered False 23:57:38.920668 run create_hlr_db(pid=15774): Terminated: ok {rc=0} 23:57:39.353273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15776): Launched 23:57:39.669829 run osmo-hlr_10.42.42.2(pid=15777): Launched 23:57:39.790096 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:40.333892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15779): Launched 23:57:40.649612 run osmo-stp_10.42.42.5(pid=15780): Launched 23:57:40.770418 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:41.341579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15782): Launched 23:57:41.657128 run osmo-msc_10.42.42.6(pid=15783): Launched 23:57:41.833684 run osmo-stp_10.42.42.5(pid=15780): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15780)] 23:57:41.967455 run osmo-stp_10.42.42.5(pid=15780): stdout: | (launched: 2022-12-13_23:57:40.591930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:42.101927 run osmo-stp_10.42.42.5(pid=15780): stderr: | [0;m[38;5;43m20221213235740785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235740785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235740786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235740786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235740786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235740787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235740787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:42.235122 run osmo-stp_10.42.42.5(pid=15780): stdout: | (launched: 2022-12-13_23:57:40.591930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:42.361112 run osmo-stp_10.42.42.5(pid=15780): stderr: | [0;m[38;5;43m20221213235740785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235740785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235740786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235740786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235740786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235740787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235740787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:42.511514 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15780): Process ended prematurely: osmo-stp_10.42.42.5(pid=15780) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15780)] [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:57:42.520865 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:57:42.548117 run osmo-hlr_10.42.42.2(pid=15777): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15777)] 23:57:42.598221 run osmo-hlr_10.42.42.2(pid=15777): stdout: | (launched: 2022-12-13_23:57:39.611513) 23:57:42.650068 run osmo-hlr_10.42.42.2(pid=15777): stderr: | [0;m[1;31m20221213235739810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235739810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235739810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235739810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235739810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235739810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235739823 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235739831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235739831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235739831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:42.721849 run osmo-msc_10.42.42.6(pid=15783): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15783)] 23:57:42.771134 run osmo-msc_10.42.42.6(pid=15783): stdout: | (launched: 2022-12-13_23:57:41.599357) 23:57:42.822243 run osmo-msc_10.42.42.6(pid=15783): stderr: | [0;m[38;5;43m20221213235741922 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235741922 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9202931c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235741922 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235741922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235741922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235741923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235741924 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235741925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235741925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235741925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:42.873809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15776): Terminating (SIGTERM) 23:57:42.914813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15779): Terminating (SIGTERM) 23:57:42.955948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15782): Terminating (SIGTERM) 23:57:42.997372 --- ParallelTerminationStrategy: PID 15776 died... 23:57:43.017387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15776): Terminated: ok {rc=0} 23:57:43.063055 --- ParallelTerminationStrategy: PID 15779 died... 23:57:43.082576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15779): Terminated: ok {rc=0} 23:57:43.128520 --- ParallelTerminationStrategy: PID 15782 died... 23:57:43.148129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15782): Terminated: ok {rc=0} 23:57:43.236891 bus /sierra_3: Setting Powered False 23:57:44.334686 bus /sierra_3: Setting Powered False 23:57:45.453575 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:57:46.602993 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:46.615592 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:57:46.685347 tst mo_mt_call_osmux.py: using LAC 37126 23:57:46.847647 tst mo_mt_call_osmux.py: using RAC 151 23:57:46.980160 tst mo_mt_call_osmux.py: using CellId 37126 23:57:47.107049 tst mo_mt_call_osmux.py: using BVCI 37127 23:57:47.225558 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:47.238198 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:47.250650 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:47.262968 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:47.276562 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:47.290065 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:57:47.405847 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:57:47.528215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:47.989677 run create_hlr_db(pid=15785): Launched 23:57:48.110392 bus /sierra_2: Setting Powered False 23:57:49.169591 run create_hlr_db(pid=15785): Terminated: ok {rc=0} 23:57:49.584567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15787): Launched 23:57:49.881172 run osmo-hlr_10.42.42.2(pid=15788): Launched 23:57:49.993901 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:50.518433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15790): Launched 23:57:50.815185 run osmo-stp_10.42.42.5(pid=15791): Launched 23:57:50.927622 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:51.466834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15793): Launched 23:57:51.762180 run osmo-msc_10.42.42.6(pid=15794): Launched 23:57:51.927567 run osmo-stp_10.42.42.5(pid=15791): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15791)] 23:57:52.053525 run osmo-stp_10.42.42.5(pid=15791): stdout: | (launched: 2022-12-13_23:57:50.761314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:52.179552 run osmo-stp_10.42.42.5(pid=15791): stderr: | [0;m[38;5;43m20221213235750931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235750932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235750932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235750933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235750933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235750933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235750933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:52.303808 run osmo-stp_10.42.42.5(pid=15791): stdout: | (launched: 2022-12-13_23:57:50.761314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:52.422035 run osmo-stp_10.42.42.5(pid=15791): stderr: | [0;m[38;5;43m20221213235750931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235750932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235750932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235750933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235750933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235750933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235750933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:52.563585 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15791): Process ended prematurely: osmo-stp_10.42.42.5(pid=15791) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15791)] [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:57:52.572318 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:57:52.598574 run osmo-hlr_10.42.42.2(pid=15788): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15788)] 23:57:52.647243 run osmo-hlr_10.42.42.2(pid=15788): stdout: | (launched: 2022-12-13_23:57:49.827194) 23:57:52.696764 run osmo-hlr_10.42.42.2(pid=15788): stderr: | [0;m[1;31m20221213235750005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235750005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235750005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235750005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235750005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235750005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235750017 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235750026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235750026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235750026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:52.765546 run osmo-msc_10.42.42.6(pid=15794): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15794)] 23:57:52.813186 run osmo-msc_10.42.42.6(pid=15794): stdout: | (launched: 2022-12-13_23:57:51.707774) 23:57:52.862273 run osmo-msc_10.42.42.6(pid=15794): stderr: | [0;m[38;5;43m20221213235751980 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235751980 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f86f9030c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235751980 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235751980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235751980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235751980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235751982 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235751983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235751983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235751983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:52.911644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15787): Terminating (SIGTERM) 23:57:52.951052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15790): Terminating (SIGTERM) 23:57:52.990340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15793): Terminating (SIGTERM) 23:57:53.029950 --- ParallelTerminationStrategy: PID 15787 died... 23:57:53.048778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15787): Terminated: ok {rc=0} 23:57:53.092301 --- ParallelTerminationStrategy: PID 15790 died... 23:57:53.110736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15790): Terminated: ok {rc=0} 23:57:53.154043 --- ParallelTerminationStrategy: PID 15793 died... 23:57:53.172430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15793): Terminated: ok {rc=0} 23:57:53.257071 bus /sierra_3: Setting Powered False 23:57:54.355887 bus /sierra_3: Setting Powered False 23:57:55.471162 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:57:56.720149 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:57:56.726552 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:57:56.758871 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:57:56.785414 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:57:56.837509 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:57:56.871335 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:57:56.898957 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:57:57.446006 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:57:57.493846 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:57.504858 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:57:57.573208 tst mo_mt_call.py: using LAC 37127 23:57:57.689762 tst mo_mt_call.py: using RAC 152 23:57:57.806305 tst mo_mt_call.py: using CellId 37127 23:57:57.924822 tst mo_mt_call.py: using BVCI 37128 23:57:58.033494 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:58.044432 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:58.055215 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:58.066120 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:58.076995 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:58.087855 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:57:58.206892 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:57:58.322845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:58.782922 run create_hlr_db(pid=15799): Launched 23:57:58.904854 bus /sierra_2: Setting Powered False 23:57:59.968298 run create_hlr_db(pid=15799): Terminated: ok {rc=0} 23:58:00.410558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15801): Launched 23:58:00.728462 run osmo-hlr_10.42.42.2(pid=15802): Launched 23:58:00.849668 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:01.493704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15804): Launched 23:58:01.833673 run osmo-stp_10.42.42.5(pid=15805): Launched 23:58:02.076791 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:02.734664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15807): Launched 23:58:03.051543 run osmo-msc_10.42.42.6(pid=15808): Launched 23:58:03.228748 run osmo-stp_10.42.42.5(pid=15805): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15805)] 23:58:03.362945 run osmo-stp_10.42.42.5(pid=15805): stdout: | (launched: 2022-12-13_23:58:01.764583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:03.498315 run osmo-stp_10.42.42.5(pid=15805): stderr: | [0;m[38;5;43m20221213235802070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235802071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235802071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235802071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235802072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235802072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235802072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:03.633022 run osmo-stp_10.42.42.5(pid=15805): stdout: | (launched: 2022-12-13_23:58:01.764583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:03.759585 run osmo-stp_10.42.42.5(pid=15805): stderr: | [0;m[38;5;43m20221213235802070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235802071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235802071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235802071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235802072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235802072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235802072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:03.910661 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15805): Process ended prematurely: osmo-stp_10.42.42.5(pid=15805) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15805)] [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:58:03.920084 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 23:58:03.948014 run osmo-hlr_10.42.42.2(pid=15802): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15802)] 23:58:03.998370 run osmo-hlr_10.42.42.2(pid=15802): stdout: | (launched: 2022-12-13_23:58:00.670532) 23:58:04.050232 run osmo-hlr_10.42.42.2(pid=15802): stderr: | [0;m[1;31m20221213235800970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235800970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235800970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235800970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235800970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235800970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235800987 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235801004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235801004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235801013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:04.122765 run osmo-msc_10.42.42.6(pid=15808): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15808)] 23:58:04.172395 run osmo-msc_10.42.42.6(pid=15808): stdout: | (launched: 2022-12-13_23:58:02.994314) 23:58:04.224326 run osmo-msc_10.42.42.6(pid=15808): stderr: | [0;m[38;5;43m20221213235803313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235803313 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f86d244dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235803313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235803313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235803313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235803314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235803315 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235803316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235803316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235803316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:04.276452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15801): Terminating (SIGTERM) 23:58:04.318181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15804): Terminating (SIGTERM) 23:58:04.360072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15807): Terminating (SIGTERM) 23:58:04.402103 --- ParallelTerminationStrategy: PID 15801 died... 23:58:04.422632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15801): Terminated: ok {rc=0} 23:58:04.468888 --- ParallelTerminationStrategy: PID 15804 died... 23:58:04.488717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15804): Terminated: ok {rc=0} 23:58:04.535181 --- ParallelTerminationStrategy: PID 15807 died... 23:58:04.555143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15807): Terminated: ok {rc=0} 23:58:04.643476 bus /sierra_3: Setting Powered False 23:58:05.742368 bus /sierra_3: Setting Powered False 23:58:06.859314 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:58:08.008411 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:08.020621 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:58:08.092677 tst mo_mt_call_osmux.py: using LAC 37128 23:58:08.218717 tst mo_mt_call_osmux.py: using RAC 153 23:58:08.342393 tst mo_mt_call_osmux.py: using CellId 37128 23:58:08.473753 tst mo_mt_call_osmux.py: using BVCI 37129 23:58:08.590651 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:08.602327 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:08.613690 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:08.625021 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:08.637084 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:08.648757 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:58:08.767004 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:58:08.884398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:09.346668 run create_hlr_db(pid=15810): Launched 23:58:09.469223 bus /sierra_2: Setting Powered False 23:58:10.529151 run create_hlr_db(pid=15810): Terminated: ok {rc=0} 23:58:10.963804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15812): Launched 23:58:11.281632 run osmo-hlr_10.42.42.2(pid=15813): Launched 23:58:11.403235 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:11.952693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15815): Launched 23:58:12.269096 run osmo-stp_10.42.42.5(pid=15816): Launched 23:58:12.390371 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:12.965619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15818): Launched 23:58:13.282419 run osmo-msc_10.42.42.6(pid=15819): Launched 23:58:13.459304 run osmo-stp_10.42.42.5(pid=15816): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15816)] 23:58:13.593639 run osmo-stp_10.42.42.5(pid=15816): stdout: | (launched: 2022-12-13_23:58:12.211485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:13.729649 run osmo-stp_10.42.42.5(pid=15816): stderr: | [0;m[38;5;43m20221213235812402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235812402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235812403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235812403 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235812403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235812403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235812404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:13.864162 run osmo-stp_10.42.42.5(pid=15816): stdout: | (launched: 2022-12-13_23:58:12.211485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:13.991128 run osmo-stp_10.42.42.5(pid=15816): stderr: | [0;m[38;5;43m20221213235812402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235812402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235812403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235812403 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235812403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235812403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235812404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:14.143026 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15816): Process ended prematurely: osmo-stp_10.42.42.5(pid=15816) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15816)] [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:58:14.152583 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:58:14.180467 run osmo-hlr_10.42.42.2(pid=15813): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15813)] 23:58:14.231344 run osmo-hlr_10.42.42.2(pid=15813): stdout: | (launched: 2022-12-13_23:58:11.224103) 23:58:14.283442 run osmo-hlr_10.42.42.2(pid=15813): stderr: | [0;m[1;31m20221213235811421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235811421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235811422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235811422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235811422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235811422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235811434 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235811442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235811442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235811442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:14.356528 run osmo-msc_10.42.42.6(pid=15819): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15819)] 23:58:14.406536 run osmo-msc_10.42.42.6(pid=15819): stdout: | (launched: 2022-12-13_23:58:13.224758) 23:58:14.458968 run osmo-msc_10.42.42.6(pid=15819): stderr: | [0;m[38;5;43m20221213235813546 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235813546 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f112e5cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235813546 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235813546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235813546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235813546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235813548 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235813548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235813549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235813549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:14.511386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15812): Terminating (SIGTERM) 23:58:14.553414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15815): Terminating (SIGTERM) 23:58:14.595509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15818): Terminating (SIGTERM) 23:58:14.638343 --- ParallelTerminationStrategy: PID 15812 died... 23:58:14.658881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15812): Terminated: ok {rc=0} 23:58:14.705477 --- ParallelTerminationStrategy: PID 15815 died... 23:58:14.725349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15815): Terminated: ok {rc=0} 23:58:14.771766 --- ParallelTerminationStrategy: PID 15818 died... 23:58:14.791758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15818): Terminated: ok {rc=0} 23:58:14.879540 bus /sierra_3: Setting Powered False 23:58:15.987287 bus /sierra_3: Setting Powered False 23:58:17.110943 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:58:18.374945 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:58:18.381838 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:58:18.415220 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:58:18.442937 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:58:18.495608 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:58:18.528212 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:58:18.555322 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:58:19.109505 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:58:19.162464 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:19.174071 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:58:19.244365 tst mo_mt_call.py: using LAC 37129 23:58:19.368651 tst mo_mt_call.py: using RAC 154 23:58:19.492632 tst mo_mt_call.py: using CellId 37129 23:58:19.621446 tst mo_mt_call.py: using BVCI 37130 23:58:19.731637 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:19.742796 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:19.753834 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:19.764682 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:19.776265 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:19.787805 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:58:19.908011 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:58:20.028706 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:20.517760 run create_hlr_db(pid=15824): Launched 23:58:20.637468 bus /sierra_2: Setting Powered False 23:58:21.700729 run create_hlr_db(pid=15824): Terminated: ok {rc=0} 23:58:22.127016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15826): Launched 23:58:22.424599 run osmo-hlr_10.42.42.2(pid=15827): Launched 23:58:22.538679 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:23.064675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15829): Launched 23:58:23.360595 run osmo-stp_10.42.42.5(pid=15830): Launched 23:58:23.473280 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:24.009648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15832): Launched 23:58:24.305537 run osmo-msc_10.42.42.6(pid=15833): Launched 23:58:24.471409 run osmo-stp_10.42.42.5(pid=15830): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15830)] 23:58:24.597349 run osmo-stp_10.42.42.5(pid=15830): stdout: | (launched: 2022-12-13_23:58:23.306325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:24.722903 run osmo-stp_10.42.42.5(pid=15830): stderr: | [0;m[38;5;43m20221213235823477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235823477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235823478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235823478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235823479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235823479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235823479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:24.846256 run osmo-stp_10.42.42.5(pid=15830): stdout: | (launched: 2022-12-13_23:58:23.306325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:24.964861 run osmo-stp_10.42.42.5(pid=15830): stderr: | [0;m[38;5;43m20221213235823477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235823477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235823478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235823478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235823479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235823479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235823479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:25.106005 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15830): Process ended prematurely: osmo-stp_10.42.42.5(pid=15830) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15830)] [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:58:25.114647 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:58:25.140395 run osmo-hlr_10.42.42.2(pid=15827): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15827)] 23:58:25.187466 run osmo-hlr_10.42.42.2(pid=15827): stdout: | (launched: 2022-12-13_23:58:22.370134) 23:58:25.236598 run osmo-hlr_10.42.42.2(pid=15827): stderr: | [0;m[1;31m20221213235822547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235822547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235822548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235822548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235822548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235822548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235822560 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235822569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235822569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235822569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:25.304605 run osmo-msc_10.42.42.6(pid=15833): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15833)] 23:58:25.351891 run osmo-msc_10.42.42.6(pid=15833): stdout: | (launched: 2022-12-13_23:58:24.251545) 23:58:25.400651 run osmo-msc_10.42.42.6(pid=15833): stderr: | [0;m[38;5;43m20221213235824522 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235824522 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6b2d6e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235824522 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235824522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235824522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235824523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235824524 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235824525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235824525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235824525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:25.449662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15826): Terminating (SIGTERM) 23:58:25.489506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15829): Terminating (SIGTERM) 23:58:25.529027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15832): Terminating (SIGTERM) 23:58:25.568563 --- ParallelTerminationStrategy: PID 15826 died... 23:58:25.587490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15826): Terminated: ok {rc=0} 23:58:25.630862 --- ParallelTerminationStrategy: PID 15829 died... 23:58:25.649385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15829): Terminated: ok {rc=0} 23:58:25.692912 --- ParallelTerminationStrategy: PID 15832 died... 23:58:25.711771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15832): Terminated: ok {rc=0} 23:58:25.794933 bus /sierra_3: Setting Powered False 23:58:26.890550 bus /sierra_3: Setting Powered False 23:58:28.003724 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:58:29.144890 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:29.156553 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:58:29.226057 tst mo_mt_call_osmux.py: using LAC 37130 23:58:29.343849 tst mo_mt_call_osmux.py: using RAC 155 23:58:29.460199 tst mo_mt_call_osmux.py: using CellId 37130 23:58:29.577469 tst mo_mt_call_osmux.py: using BVCI 37131 23:58:29.685065 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:29.696163 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:29.706942 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:29.717814 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:29.728535 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:29.740049 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:58:29.855825 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:58:29.973270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:30.461985 run create_hlr_db(pid=15835): Launched 23:58:30.582837 bus /sierra_2: Setting Powered False 23:58:31.644688 run create_hlr_db(pid=15835): Terminated: ok {rc=0} 23:58:32.101756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15837): Launched 23:58:32.410251 run osmo-hlr_10.42.42.2(pid=15838): Launched 23:58:32.523015 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:33.034249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15840): Launched 23:58:33.329672 run osmo-stp_10.42.42.5(pid=15841): Launched 23:58:33.441583 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:33.977077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15843): Launched 23:58:34.273463 run osmo-msc_10.42.42.6(pid=15844): Launched 23:58:34.439942 run osmo-stp_10.42.42.5(pid=15841): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15841)] 23:58:34.565564 run osmo-stp_10.42.42.5(pid=15841): stdout: | (launched: 2022-12-13_23:58:33.275586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:34.691426 run osmo-stp_10.42.42.5(pid=15841): stderr: | [0;m[38;5;43m20221213235833445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235833445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235833446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235833446 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235833447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235833447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235833447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:34.814753 run osmo-stp_10.42.42.5(pid=15841): stdout: | (launched: 2022-12-13_23:58:33.275586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:34.932716 run osmo-stp_10.42.42.5(pid=15841): stderr: | [0;m[38;5;43m20221213235833445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235833445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235833446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235833446 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235833447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235833447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235833447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:35.074273 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15841): Process ended prematurely: osmo-stp_10.42.42.5(pid=15841) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15841)] [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:58:35.082962 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:58:35.109100 run osmo-hlr_10.42.42.2(pid=15838): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15838)] 23:58:35.157123 run osmo-hlr_10.42.42.2(pid=15838): stdout: | (launched: 2022-12-13_23:58:32.356064) 23:58:35.206049 run osmo-hlr_10.42.42.2(pid=15838): stderr: | [0;m[1;31m20221213235832533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235832533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235832533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235832533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235832533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235832533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235832547 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235832555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235832555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235832555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:35.274525 run osmo-msc_10.42.42.6(pid=15844): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15844)] 23:58:35.322446 run osmo-msc_10.42.42.6(pid=15844): stdout: | (launched: 2022-12-13_23:58:34.219223) 23:58:35.371457 run osmo-msc_10.42.42.6(pid=15844): stderr: | [0;m[38;5;43m20221213235834490 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235834490 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7112e34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235834491 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235834491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235834491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235834491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235834494 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235834494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235834494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235834494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:35.420858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15837): Terminating (SIGTERM) 23:58:35.460062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15840): Terminating (SIGTERM) 23:58:35.499300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15843): Terminating (SIGTERM) 23:58:35.538731 --- ParallelTerminationStrategy: PID 15837 died... 23:58:35.557676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15837): Terminated: ok {rc=0} 23:58:35.601360 --- ParallelTerminationStrategy: PID 15840 died... 23:58:35.619871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15840): Terminated: ok {rc=0} 23:58:35.663579 --- ParallelTerminationStrategy: PID 15843 died... 23:58:35.682017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15843): Terminated: ok {rc=0} 23:58:35.767134 bus /sierra_3: Setting Powered False 23:58:36.866522 bus /sierra_3: Setting Powered False 23:58:37.979956 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:58:39.234730 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:58:39.241795 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:58:39.275381 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:58:39.304823 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:58:39.358354 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:58:39.391460 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:58:39.418240 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:58:39.971199 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:58:40.023487 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:40.035209 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:58:40.107373 tst mo_mt_call.py: using LAC 37131 23:58:40.231650 tst mo_mt_call.py: using RAC 156 23:58:40.355860 tst mo_mt_call.py: using CellId 37131 23:58:40.479871 tst mo_mt_call.py: using BVCI 37132 23:58:40.595010 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:40.606604 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:40.618055 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:40.629501 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:40.641460 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:40.653636 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:58:40.774238 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:58:40.891510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:41.353249 run create_hlr_db(pid=15849): Launched 23:58:41.475645 bus /sierra_2: Setting Powered False 23:58:42.539223 run create_hlr_db(pid=15849): Terminated: ok {rc=0} 23:58:42.980824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15851): Launched 23:58:43.296892 run osmo-hlr_10.42.42.2(pid=15852): Launched 23:58:43.418237 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:43.966298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15854): Launched 23:58:44.282786 run osmo-stp_10.42.42.5(pid=15855): Launched 23:58:44.404185 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:44.977519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15857): Launched 23:58:45.295178 run osmo-msc_10.42.42.6(pid=15858): Launched 23:58:45.471985 run osmo-stp_10.42.42.5(pid=15855): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15855)] 23:58:45.606185 run osmo-stp_10.42.42.5(pid=15855): stdout: | (launched: 2022-12-13_23:58:44.225189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:45.741217 run osmo-stp_10.42.42.5(pid=15855): stderr: | [0;m[38;5;43m20221213235844415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235844415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235844415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235844416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235844418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235844418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235844418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:45.894065 run osmo-stp_10.42.42.5(pid=15855): stdout: | (launched: 2022-12-13_23:58:44.225189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:46.035434 run osmo-stp_10.42.42.5(pid=15855): stderr: | [0;m[38;5;43m20221213235844415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235844415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235844415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235844416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235844418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235844418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235844418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:46.190304 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15855): Process ended prematurely: osmo-stp_10.42.42.5(pid=15855) [trial-2396↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15855)] [trial-2396↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:58:46.200663 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:58:46.229578 run osmo-hlr_10.42.42.2(pid=15852): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15852)] 23:58:46.283142 run osmo-hlr_10.42.42.2(pid=15852): stdout: | (launched: 2022-12-13_23:58:43.239493) 23:58:46.337065 run osmo-hlr_10.42.42.2(pid=15852): stderr: | [0;m[1;31m20221213235843435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235843435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235843435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235843435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235843435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235843435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235843446 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235843454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235843454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235843454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:46.413173 run osmo-msc_10.42.42.6(pid=15858): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15858)] 23:58:46.464343 run osmo-msc_10.42.42.6(pid=15858): stdout: | (launched: 2022-12-13_23:58:45.236661) 23:58:46.518250 run osmo-msc_10.42.42.6(pid=15858): stderr: | [0;m[38;5;43m20221213235845557 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235845557 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4899f07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235845557 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235845557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235845557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235845558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235845559 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235845560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235845560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235845560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:46.574096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15851): Terminating (SIGTERM) 23:58:46.617280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15854): Terminating (SIGTERM) 23:58:46.661612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15857): Terminating (SIGTERM) 23:58:46.706975 --- ParallelTerminationStrategy: PID 15851 died... 23:58:46.728487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15851): Terminated: ok {rc=0} 23:58:46.776020 --- ParallelTerminationStrategy: PID 15854 died... 23:58:46.796942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15854): Terminated: ok {rc=0} 23:58:46.844431 --- ParallelTerminationStrategy: PID 15857 died... 23:58:46.865502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15857): Terminated: ok {rc=0} 23:58:46.955326 bus /sierra_3: Setting Powered False 23:58:48.054983 bus /sierra_3: Setting Powered False 23:58:49.173003 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:58:50.317932 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:50.330024 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:58:50.400585 tst mo_mt_call_osmux.py: using LAC 37132 23:58:50.517328 tst mo_mt_call_osmux.py: using RAC 157 23:58:50.635440 tst mo_mt_call_osmux.py: using CellId 37132 23:58:50.752465 tst mo_mt_call_osmux.py: using BVCI 37133 23:58:50.861828 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:50.873009 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:50.883963 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:50.894883 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:50.905959 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:50.916791 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:58:51.031781 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:58:51.150779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:51.642023 run create_hlr_db(pid=15860): Launched 23:58:51.764478 bus /sierra_2: Setting Powered False 23:58:52.828021 run create_hlr_db(pid=15860): Terminated: ok {rc=0} 23:58:53.270327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15862): Launched 23:58:53.587014 run osmo-hlr_10.42.42.2(pid=15863): Launched 23:58:53.709082 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:54.256659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15865): Launched 23:58:54.572829 run osmo-stp_10.42.42.5(pid=15866): Launched 23:58:54.694435 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:55.272016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15868): Launched 23:58:55.589683 run osmo-msc_10.42.42.6(pid=15869): Launched 23:58:55.767210 run osmo-stp_10.42.42.5(pid=15866): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15866)] 23:58:55.901946 run osmo-stp_10.42.42.5(pid=15866): stdout: | (launched: 2022-12-13_23:58:54.515430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:56.037167 run osmo-stp_10.42.42.5(pid=15866): stderr: | [0;m[38;5;43m20221213235854708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235854708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235854709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235854709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235854710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235854710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235854710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:56.171523 run osmo-stp_10.42.42.5(pid=15866): stdout: | (launched: 2022-12-13_23:58:54.515430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:56.298346 run osmo-stp_10.42.42.5(pid=15866): stderr: | [0;m[38;5;43m20221213235854708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235854708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235854709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235854709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235854710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235854710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235854710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:56.450122 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15866): Process ended prematurely: osmo-stp_10.42.42.5(pid=15866) [trial-2396↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15866)] [trial-2396↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:58:56.459760 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:58:56.487725 run osmo-hlr_10.42.42.2(pid=15863): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15863)] 23:58:56.539148 run osmo-hlr_10.42.42.2(pid=15863): stdout: | (launched: 2022-12-13_23:58:53.529508) 23:58:56.591342 run osmo-hlr_10.42.42.2(pid=15863): stderr: | [0;m[1;31m20221213235853728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235853728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235853728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235853728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235853728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235853728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235853739 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235853747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235853747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235853748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:56.664301 run osmo-msc_10.42.42.6(pid=15869): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15869)] 23:58:56.714209 run osmo-msc_10.42.42.6(pid=15869): stdout: | (launched: 2022-12-13_23:58:55.532116) 23:58:56.766041 run osmo-msc_10.42.42.6(pid=15869): stderr: | [0;m[38;5;43m20221213235855852 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235855852 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6b21b2bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235855853 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235855853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235855853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235855853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235855855 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235855855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235855855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235855855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:56.818128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15862): Terminating (SIGTERM) 23:58:56.859723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15865): Terminating (SIGTERM) 23:58:56.901365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15868): Terminating (SIGTERM) 23:58:56.943119 --- ParallelTerminationStrategy: PID 15862 died... 23:58:56.963383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15862): Terminated: ok {rc=0} 23:58:57.009596 --- ParallelTerminationStrategy: PID 15865 died... 23:58:57.029386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15865): Terminated: ok {rc=0} 23:58:57.075272 --- ParallelTerminationStrategy: PID 15868 died... 23:58:57.095145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15868): Terminated: ok {rc=0} 23:58:57.183326 bus /sierra_3: Setting Powered False 23:58:58.278262 bus /sierra_3: Setting Powered False 23:58:59.392653 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:59:00.639186 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:59:00.644634 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:59:00.677114 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:59:00.703468 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:59:00.756227 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:59:00.790776 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:59:00.818281 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:59:01.368290 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:59:01.418529 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:01.430331 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:59:01.500850 tst mo_mt_call.py: using LAC 37133 23:59:01.630349 tst mo_mt_call.py: using RAC 158 23:59:01.769479 tst mo_mt_call.py: using CellId 37133 23:59:01.923723 tst mo_mt_call.py: using BVCI 37134 23:59:02.067723 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:02.081737 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:02.095232 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:02.107441 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:02.120640 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:02.134363 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:59:02.257600 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:59:02.381873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:02.872030 run create_hlr_db(pid=15875): Launched 23:59:02.994949 bus /sierra_2: Setting Powered False 23:59:04.058031 run create_hlr_db(pid=15875): Terminated: ok {rc=0} 23:59:04.481544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15877): Launched 23:59:04.778114 run osmo-hlr_10.42.42.2(pid=15878): Launched 23:59:04.891041 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:05.400734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15880): Launched 23:59:05.697544 run osmo-stp_10.42.42.5(pid=15881): Launched 23:59:05.809821 run osmo-msc_10.42.42.6: Starting osmo-msc 23:59:06.345629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15884): Launched 23:59:06.641528 run osmo-msc_10.42.42.6(pid=15885): Launched 23:59:06.807356 run osmo-stp_10.42.42.5(pid=15881): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15881)] 23:59:06.933079 run osmo-stp_10.42.42.5(pid=15881): stdout: | (launched: 2022-12-13_23:59:05.642440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:07.059493 run osmo-stp_10.42.42.5(pid=15881): stderr: | [0;m[38;5;43m20221213235905814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235905814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235905814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235905814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235905815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235905815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235905815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:07.183352 run osmo-stp_10.42.42.5(pid=15881): stdout: | (launched: 2022-12-13_23:59:05.642440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:07.302253 run osmo-stp_10.42.42.5(pid=15881): stderr: | [0;m[38;5;43m20221213235905814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235905814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235905814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235905814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235905815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235905815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235905815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:07.443744 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15881): Process ended prematurely: osmo-stp_10.42.42.5(pid=15881) [trial-2396↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15881)] [trial-2396↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:59:07.452478 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:59:07.478582 run osmo-hlr_10.42.42.2(pid=15878): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15878)] 23:59:07.526012 run osmo-hlr_10.42.42.2(pid=15878): stdout: | (launched: 2022-12-13_23:59:04.724056) 23:59:07.575248 run osmo-hlr_10.42.42.2(pid=15878): stderr: | [0;m[1;31m20221213235904901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235904901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235904901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235904901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235904901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235904901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235904937 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235904947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235904947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235904947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:07.643723 run osmo-msc_10.42.42.6(pid=15885): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15885)] 23:59:07.691472 run osmo-msc_10.42.42.6(pid=15885): stdout: | (launched: 2022-12-13_23:59:06.587284) 23:59:07.740315 run osmo-msc_10.42.42.6(pid=15885): stderr: | [0;m[38;5;43m20221213235906858 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235906858 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcc1add8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235906858 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235906858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235906859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235906859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235906860 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235906861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235906861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235906861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:59:07.789421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15877): Terminating (SIGTERM) 23:59:07.828428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15880): Terminating (SIGTERM) 23:59:07.867541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15884): Terminating (SIGTERM) 23:59:07.906822 --- ParallelTerminationStrategy: PID 15877 died... 23:59:07.925838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15877): Terminated: ok {rc=0} 23:59:07.969235 --- ParallelTerminationStrategy: PID 15880 died... 23:59:07.987628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15880): Terminated: ok {rc=0} 23:59:08.030990 --- ParallelTerminationStrategy: PID 15884 died... 23:59:08.049405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15884): Terminated: ok {rc=0} 23:59:08.135328 bus /sierra_3: Setting Powered False 23:59:09.235739 bus /sierra_3: Setting Powered False 23:59:10.353168 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:59:11.500321 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:11.512381 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:59:11.585300 tst mo_mt_call_osmux.py: using LAC 37134 23:59:11.711078 tst mo_mt_call_osmux.py: using RAC 159 23:59:11.837147 tst mo_mt_call_osmux.py: using CellId 37134 23:59:11.981384 tst mo_mt_call_osmux.py: using BVCI 37135 23:59:12.098028 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:12.109585 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:12.120610 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:12.131802 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:12.143380 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:12.155183 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:59:12.271938 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:59:12.391132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:12.882136 run create_hlr_db(pid=15887): Launched 23:59:13.002229 bus /sierra_2: Setting Powered False 23:59:14.065401 run create_hlr_db(pid=15887): Terminated: ok {rc=0} 23:59:14.489151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15889): Launched 23:59:14.807085 run osmo-hlr_10.42.42.2(pid=15890): Launched 23:59:14.928476 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:15.472348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15892): Launched 23:59:15.788941 run osmo-stp_10.42.42.5(pid=15893): Launched 23:59:15.909452 run osmo-msc_10.42.42.6: Starting osmo-msc 23:59:16.649911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15895): Launched 23:59:16.978750 run osmo-msc_10.42.42.6(pid=15896): Launched 23:59:17.436744 run osmo-stp_10.42.42.5(pid=15893): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15893)] 23:59:17.574385 run osmo-stp_10.42.42.5(pid=15893): stdout: | (launched: 2022-12-13_23:59:15.731749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:17.697899 run osmo-stp_10.42.42.5(pid=15893): stderr: | [0;m[38;5;43m20221213235916051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235916051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235916052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235916052 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235916053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235916053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235916053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:17.822017 run osmo-stp_10.42.42.5(pid=15893): stdout: | (launched: 2022-12-13_23:59:15.731749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:17.940071 run osmo-stp_10.42.42.5(pid=15893): stderr: | [0;m[38;5;43m20221213235916051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235916051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235916052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235916052 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235916053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235916053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235916053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:18.081938 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15893): Process ended prematurely: osmo-stp_10.42.42.5(pid=15893) [trial-2396↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15893)] [trial-2396↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:59:18.090586 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 23:59:18.117124 run osmo-hlr_10.42.42.2(pid=15890): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15890)] 23:59:18.165725 run osmo-hlr_10.42.42.2(pid=15890): stdout: | (launched: 2022-12-13_23:59:14.749965) 23:59:18.215191 run osmo-hlr_10.42.42.2(pid=15890): stderr: | [0;m[1;31m20221213235914946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235914946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235914946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235914946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235914946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235914946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235914959 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235914969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235914969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235914969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:18.284767 run osmo-msc_10.42.42.6(pid=15896): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15896)] 23:59:18.334238 run osmo-msc_10.42.42.6(pid=15896): stdout: | (launched: 2022-12-13_23:59:16.915434) 23:59:18.383820 run osmo-msc_10.42.42.6(pid=15896): stderr: | [0;m[38;5;43m20221213235917247 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235917247 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc19a5a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235917247 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235917247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235917248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235917248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235917252 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235917254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235917254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235917254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:59:18.433658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15889): Terminating (SIGTERM) 23:59:18.473498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15892): Terminating (SIGTERM) 23:59:18.513199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15895): Terminating (SIGTERM) 23:59:18.553953 --- ParallelTerminationStrategy: PID 15889 died... 23:59:18.573079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15889): Terminated: ok {rc=0} 23:59:18.616997 --- ParallelTerminationStrategy: PID 15892 died... 23:59:18.636000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15892): Terminated: ok {rc=0} 23:59:18.679811 --- ParallelTerminationStrategy: PID 15895 died... 23:59:18.698577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15895): Terminated: ok {rc=0} 23:59:18.784317 bus /sierra_3: Setting Powered False 23:59:19.883664 bus /sierra_3: Setting Powered False 23:59:20.996906 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 emergency:trx-lms --------------------------------------------------------------------- 23:59:22.248323 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:59:22.253235 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 23:59:22.286692 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 23:59:22.315209 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 23:59:22.400830 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 23:59:22.435007 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 23:59:22.462555 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 23:59:23.046904 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2396 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 23:59:23.052399 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:23.063660 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 23:59:23.114098 tst emergency_mo_mt_call.py: using LAC 37135 23:59:23.237242 tst emergency_mo_mt_call.py: using RAC 160 23:59:23.359001 tst emergency_mo_mt_call.py: using CellId 37135 23:59:23.479056 tst emergency_mo_mt_call.py: using BVCI 37136 23:59:23.592122 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:23.603415 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:23.614477 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:23.625642 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:23.636703 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:23.648019 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:23.763033 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:23.882770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:24.363352 run create_hlr_db(pid=15901): Launched 23:59:24.481972 bus /sierra_2: Setting Powered False 23:59:25.543323 run create_hlr_db(pid=15901): Terminated: ok {rc=0} 23:59:25.962872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15903): Launched 23:59:26.252877 run osmo-hlr_10.42.42.2(pid=15904): Launched 23:59:26.364056 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:26.880197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15906): Launched 23:59:27.170585 run osmo-stp_10.42.42.5(pid=15907): Launched 23:59:27.290978 tst emergency_mo_mt_call.py: using MSISDN 8395 23:59:27.446623 run osmo-msc_10.42.42.6: Starting osmo-msc 23:59:28.007991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15909): Launched 23:59:28.319438 run osmo-msc_10.42.42.6(pid=15910): Launched 23:59:28.493338 run osmo-stp_10.42.42.5(pid=15907): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15907)] 23:59:28.627865 run osmo-stp_10.42.42.5(pid=15907): stdout: | (launched: 2022-12-13_23:59:27.117129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:28.759016 run osmo-stp_10.42.42.5(pid=15907): stderr: | [0;m[38;5;43m20221213235927285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235927285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235927286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235927286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235927287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235927287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235927287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:28.889575 run osmo-stp_10.42.42.5(pid=15907): stdout: | (launched: 2022-12-13_23:59:27.117129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:29.013678 run osmo-stp_10.42.42.5(pid=15907): stderr: | [0;m[38;5;43m20221213235927285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235927285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235927286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235927286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235927287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235927287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235927287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:29.162351 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15907): Process ended prematurely: osmo-stp_10.42.42.5(pid=15907) [trial-2396↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15907)] [trial-2396↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 23:59:29.171216 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 23:59:29.198553 run osmo-hlr_10.42.42.2(pid=15904): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15904)] 23:59:29.249315 run osmo-hlr_10.42.42.2(pid=15904): stdout: | (launched: 2022-12-13_23:59:26.199864) 23:59:29.301606 run osmo-hlr_10.42.42.2(pid=15904): stderr: | [0;m[1;31m20221213235926376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235926376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235926376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235926376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235926376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235926376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235926388 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235926396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235926396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235926396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:29.374146 run osmo-msc_10.42.42.6(pid=15910): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15910)] 23:59:29.424548 run osmo-msc_10.42.42.6(pid=15910): stdout: | (launched: 2022-12-13_23:59:28.262736) 23:59:29.476361 run osmo-msc_10.42.42.6(pid=15910): stderr: | [0;m[38;5;43m20221213235928583 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235928584 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f65e8589c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235928584 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235928584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235928584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235928584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235928586 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235928586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235928586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235928587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:59:29.528586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15903): Terminating (SIGTERM) 23:59:29.570625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15906): Terminating (SIGTERM) 23:59:29.613299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15909): Terminating (SIGTERM) 23:59:29.655819 --- ParallelTerminationStrategy: PID 15903 died... 23:59:29.676641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15903): Terminated: ok {rc=0} 23:59:29.723410 --- ParallelTerminationStrategy: PID 15906 died... 23:59:29.743409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15906): Terminated: ok {rc=0} 23:59:29.789364 --- ParallelTerminationStrategy: PID 15909 died... 23:59:29.809190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15909): Terminated: ok {rc=0} 23:59:29.897227 bus /sierra_3: Setting Powered False 23:59:30.993815 bus /sierra_3: Setting Powered False 23:59:32.105388 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 23:59:33.190615 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:33.201754 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 23:59:33.252448 tst emergency_preemptive_call.py: using LAC 37136 23:59:33.367628 tst emergency_preemptive_call.py: using RAC 161 23:59:33.482154 tst emergency_preemptive_call.py: using CellId 37136 23:59:33.596702 tst emergency_preemptive_call.py: using BVCI 37137 23:59:33.712129 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:33.723447 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:33.734633 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:33.745776 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:33.757753 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:33.769681 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:33.886220 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:34.007782 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:34.122374 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:34.235514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:34.688347 run create_hlr_db(pid=15912): Launched 23:59:34.809343 bus /sierra_2: Setting Powered False 23:59:35.868142 run create_hlr_db(pid=15912): Terminated: ok {rc=0} 23:59:36.275246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15914): Launched 23:59:36.566481 run osmo-hlr_10.42.42.2(pid=15915): Launched 23:59:36.676872 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:37.193699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15917): Launched 23:59:37.485396 run osmo-stp_10.42.42.5(pid=15918): Launched 23:59:37.606154 tst emergency_preemptive_call.py: using MSISDN 8396 23:59:37.758164 run osmo-msc_10.42.42.6: Starting osmo-msc 23:59:38.282321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15920): Launched 23:59:38.573616 run osmo-msc_10.42.42.6(pid=15921): Launched 23:59:38.736497 run osmo-stp_10.42.42.5(pid=15918): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15918)] 23:59:38.863791 run osmo-stp_10.42.42.5(pid=15918): stdout: | (launched: 2022-12-13_23:59:37.431569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:38.988043 run osmo-stp_10.42.42.5(pid=15918): stderr: | [0;m[38;5;43m20221213235937601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235937601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235937601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235937602 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235937602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235937602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235937602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:39.109712 run osmo-stp_10.42.42.5(pid=15918): stdout: | (launched: 2022-12-13_23:59:37.431569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:39.225514 run osmo-stp_10.42.42.5(pid=15918): stderr: | [0;m[38;5;43m20221213235937601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235937601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235937601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235937602 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235937602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235937602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235937602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:39.363918 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15918): Process ended prematurely: osmo-stp_10.42.42.5(pid=15918) [trial-2396↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15918)] [trial-2396↪emergency:trx-lms↪emergency_preemptive_call.py:32] 23:59:39.372235 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 23:59:39.398381 run osmo-hlr_10.42.42.2(pid=15915): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15915)] 23:59:39.446172 run osmo-hlr_10.42.42.2(pid=15915): stdout: | (launched: 2022-12-13_23:59:36.513252) 23:59:39.496186 run osmo-hlr_10.42.42.2(pid=15915): stderr: | [0;m[1;31m20221213235936690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235936690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235936690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235936690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235936690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235936690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235936703 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235936711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235936712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235936712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:39.565643 run osmo-msc_10.42.42.6(pid=15921): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15921)] 23:59:39.613303 run osmo-msc_10.42.42.6(pid=15921): stdout: | (launched: 2022-12-13_23:59:38.519985) 23:59:39.662532 run osmo-msc_10.42.42.6(pid=15921): stderr: | [0;m[38;5;43m20221213235938791 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221213235938791 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f94fce2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221213235938791 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221213235938791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221213235938791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221213235938792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221213235938793 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221213235938794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213235938794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213235938794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:59:39.712200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15914): Terminating (SIGTERM) 23:59:39.751788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15917): Terminating (SIGTERM) 23:59:39.791277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15920): Terminating (SIGTERM) 23:59:39.831042 --- ParallelTerminationStrategy: PID 15914 died... 23:59:39.850329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15914): Terminated: ok {rc=0} 23:59:39.894325 --- ParallelTerminationStrategy: PID 15917 died... 23:59:39.912779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15917): Terminated: ok {rc=0} 23:59:39.957563 --- ParallelTerminationStrategy: PID 15920 died... 23:59:39.976032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15920): Terminated: ok {rc=0} 23:59:40.062439 bus /sierra_9: Setting Powered False 23:59:41.161834 bus /sierra_9: Setting Powered False 23:59:42.274669 bus /sierra_8: Setting Powered False 23:59:43.373224 bus /sierra_8: Setting Powered False 23:59:44.489573 bus /sierra_3: Setting Powered False 23:59:45.587013 bus /sierra_3: Setting Powered False 23:59:46.711961 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-lms --------------------------------------------------------------------- 23:59:47.994865 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:59:47.999368 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 23:59:48.031704 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 23:59:48.069748 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 23:59:48.155659 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 23:59:48.188268 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 23:59:48.226281 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 23:59:48.815310 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 23:59:48.863744 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:48.874305 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 23:59:48.922217 tst cs_paging_gprs_active.py: using LAC 37137 23:59:49.046593 tst cs_paging_gprs_active.py: using RAC 162 23:59:49.172076 tst cs_paging_gprs_active.py: using CellId 37137 23:59:49.298308 tst cs_paging_gprs_active.py: using BVCI 37138 23:59:49.413608 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:49.424761 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:49.436024 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:49.447022 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:49.458341 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:49.469493 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:49.480719 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:49.491740 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:49.502854 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 23:59:49.620010 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 23:59:49.738816 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:59:49.953860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:59:50.273398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15927): Launched 23:59:50.550470 run iperf3-srv_10.42.42.10(pid=15928): Launched 23:59:50.669712 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:59:50.884289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:59:51.204164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15929): Launched 23:59:51.480443 run iperf3-srv_10.42.42.10(pid=15930): Launched 23:59:51.600120 tst cs_paging_gprs_active.py:38: start network... 23:59:51.815643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:52.309204 run create_hlr_db(pid=15931): Launched 23:59:52.430072 bus /sierra_2: Setting Powered False 23:59:53.492866 run create_hlr_db(pid=15931): Terminated: ok {rc=0} 23:59:53.919632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15933): Launched 23:59:54.217693 run osmo-hlr_10.42.42.2(pid=15934): Launched 23:59:54.330360 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:54.841994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15936): Launched 23:59:55.138974 run osmo-stp_10.42.42.5(pid=15937): Launched 23:59:55.252301 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:59:55.767119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15939): Launched 23:59:55.881117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:59:56.133164 run patchelf(pid=15940): Launched 23:59:56.299050 run osmo-stp_10.42.42.5(pid=15937): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15937)] 23:59:56.424698 run osmo-stp_10.42.42.5(pid=15937): stdout: | (launched: 2022-12-13_23:59:55.084321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:56.552401 run osmo-stp_10.42.42.5(pid=15937): stderr: | [0;m[38;5;43m20221213235955253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235955253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235955254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235955254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235955254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235955255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235955255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:56.680261 run osmo-stp_10.42.42.5(pid=15937): stdout: | (launched: 2022-12-13_23:59:55.084321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:56.802428 run osmo-stp_10.42.42.5(pid=15937): stderr: | [0;m[38;5;43m20221213235955253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221213235955253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221213235955254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221213235955254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213235955254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213235955255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213235955255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:56.947141 run patchelf(pid=15940): Terminating (SIGINT) 23:59:57.114180 run patchelf(pid=15940): Terminated: ok {rc=0} 23:59:57.234626 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15937): Process ended prematurely: osmo-stp_10.42.42.5(pid=15937) [trial-2396↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15937)] [trial-2396↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 23:59:57.243862 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 23:59:57.270882 run osmo-hlr_10.42.42.2(pid=15934): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15934)] 23:59:57.318726 run osmo-hlr_10.42.42.2(pid=15934): stdout: | (launched: 2022-12-13_23:59:54.163656) 23:59:57.367988 run osmo-hlr_10.42.42.2(pid=15934): stderr: | [0;m[1;31m20221213235954338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221213235954338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221213235954338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221213235954338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221213235954339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221213235954339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221213235954351 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221213235954360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213235954360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213235954360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:57.417770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15927): Terminating (SIGTERM) 23:59:57.457654 run iperf3-srv_10.42.42.10(pid=15928): Terminating (SIGTERM) 23:59:57.497349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15929): Terminating (SIGTERM) 23:59:57.537144 run iperf3-srv_10.42.42.10(pid=15930): Terminating (SIGTERM) 23:59:57.576744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15933): Terminating (SIGTERM) 23:59:57.616655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15936): Terminating (SIGTERM) 23:59:57.656458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15939): Terminating (SIGTERM) 23:59:57.696369 --- ParallelTerminationStrategy: PID 15927 died... 23:59:57.715536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15927): Terminated: ok {rc=0} 23:59:57.759503 --- ParallelTerminationStrategy: PID 15928 died... 23:59:57.778133 run iperf3-srv_10.42.42.10(pid=15928): Terminated {rc=256} 23:59:57.821869 --- ParallelTerminationStrategy: PID 15929 died... 23:59:57.840528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15929): Terminated: ok {rc=0} 23:59:57.884256 --- ParallelTerminationStrategy: PID 15930 died... 23:59:57.902781 run iperf3-srv_10.42.42.10(pid=15930): Terminated {rc=256} 23:59:57.946451 --- ParallelTerminationStrategy: PID 15933 died... 23:59:57.965119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15933): Terminated: ok {rc=0} 23:59:58.008742 --- ParallelTerminationStrategy: PID 15936 died... 23:59:58.027339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15936): Terminated: ok {rc=0} 23:59:58.071052 --- ParallelTerminationStrategy: PID 15939 died... 23:59:58.089690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15939): Terminated: ok {rc=0} 23:59:58.174961 bus /gobi_0: Setting Powered False 23:59:59.273643 bus /gobi_0: Setting Powered False 00:00:00.385960 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms iperf3.py ---------------------------------------------- 00:00:01.568539 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:01.580837 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 00:00:01.654832 tst iperf3.py: using LAC 37138 00:00:01.791170 tst iperf3.py: using RAC 163 00:00:01.942451 tst iperf3.py: using CellId 37138 00:00:02.126651 tst iperf3.py: using BVCI 37139 00:00:02.306812 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:02.320711 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:02.335715 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:02.354124 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:02.368783 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:02.382973 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:02.396579 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:02.412505 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:02.425634 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:02.595650 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:00:02.848512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:03.262508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15971): Launched 00:00:03.571422 run iperf3-srv_10.42.42.10(pid=15973): Launched 00:00:03.750132 tst iperf3.py:8: start network... 00:00:03.998461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:04.514386 run create_hlr_db(pid=15975): Launched 00:00:04.655139 bus /gobi_6: Setting Powered False 00:00:05.716493 run create_hlr_db(pid=15975): Terminated: ok {rc=0} 00:00:06.182767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15984): Launched 00:00:06.501630 run osmo-hlr_10.42.42.2(pid=15985): Launched 00:00:06.623919 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:07.154401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15987): Launched 00:00:07.452045 run osmo-stp_10.42.42.5(pid=15988): Launched 00:00:07.565533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:08.076311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15990): Launched 00:00:08.189421 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:08.440331 run patchelf(pid=15991): Launched 00:00:08.605853 run osmo-stp_10.42.42.5(pid=15988): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15988)] 00:00:08.733913 run osmo-stp_10.42.42.5(pid=15988): stdout: | (launched: 2022-12-14_00:00:07.397229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:08.861805 run osmo-stp_10.42.42.5(pid=15988): stderr: | [0;m[38;5;43m20221214000007570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000007570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000007570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000007571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000007571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000007571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000007571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:08.989162 run osmo-stp_10.42.42.5(pid=15988): stdout: | (launched: 2022-12-14_00:00:07.397229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:09.110883 run osmo-stp_10.42.42.5(pid=15988): stderr: | [0;m[38;5;43m20221214000007570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000007570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000007570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000007571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000007571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000007571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000007571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:09.255237 run patchelf(pid=15991): Terminating (SIGINT) 00:00:09.422617 run patchelf(pid=15991): Terminated: ok {rc=0} 00:00:09.543137 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15988): Process ended prematurely: osmo-stp_10.42.42.5(pid=15988) [trial-2396↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15988)] [trial-2396↪gprs:trx-lms↪iperf3.py:8] 00:00:09.552414 tst iperf3.py:8: Test FAILED (8.0 sec) 00:00:09.579310 run osmo-hlr_10.42.42.2(pid=15985): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15985)] 00:00:09.626663 run osmo-hlr_10.42.42.2(pid=15985): stdout: | (launched: 2022-12-14_00:00:06.444010) 00:00:09.675557 run osmo-hlr_10.42.42.2(pid=15985): stderr: | [0;m[1;31m20221214000006643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000006643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000006643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000006643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000006643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000006643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000006655 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000006664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000006664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000006664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:09.725387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15971): Terminating (SIGTERM) 00:00:09.765663 run iperf3-srv_10.42.42.10(pid=15973): Terminating (SIGTERM) 00:00:09.805301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15984): Terminating (SIGTERM) 00:00:09.845344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15987): Terminating (SIGTERM) 00:00:09.884933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15990): Terminating (SIGTERM) 00:00:09.924636 --- ParallelTerminationStrategy: PID 15971 died... 00:00:09.943798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15971): Terminated: ok {rc=0} 00:00:09.987584 --- ParallelTerminationStrategy: PID 15973 died... 00:00:10.006193 run iperf3-srv_10.42.42.10(pid=15973): Terminated {rc=256} 00:00:10.049720 --- ParallelTerminationStrategy: PID 15984 died... 00:00:10.068172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15984): Terminated: ok {rc=0} 00:00:10.111834 --- ParallelTerminationStrategy: PID 15987 died... 00:00:10.130484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15987): Terminated: ok {rc=0} 00:00:10.174106 --- ParallelTerminationStrategy: PID 15990 died... 00:00:10.192806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15990): Terminated: ok {rc=0} 00:00:10.275308 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms iperf3m4.py ---------------------------------------------- 00:00:11.423281 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:11.435007 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 00:00:11.496160 tst iperf3m4.py: using LAC 37139 00:00:11.625165 tst iperf3m4.py: using RAC 164 00:00:11.752027 tst iperf3m4.py: using CellId 37139 00:00:11.878102 tst iperf3m4.py: using BVCI 37140 00:00:11.994310 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:12.005374 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:12.016184 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:12.026983 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:12.038067 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:12.049277 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:12.060438 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:12.071568 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:12.082880 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:12.202027 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:12.324262 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:12.443689 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:12.560879 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:00:12.760692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:13.057740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15993): Launched 00:00:13.315374 run iperf3-srv_10.42.42.10(pid=15994): Launched 00:00:13.426312 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:00:13.625630 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:13.924203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15996): Launched 00:00:14.181786 run iperf3-srv_10.42.42.10(pid=15997): Launched 00:00:14.292877 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:00:14.492311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:14.790210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15998): Launched 00:00:15.048095 run iperf3-srv_10.42.42.10(pid=15999): Launched 00:00:15.159485 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:00:15.357733 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:15.655344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16000): Launched 00:00:15.940725 run iperf3-srv_10.42.42.10(pid=16001): Launched 00:00:16.071895 tst iperf3m4.py:8: start network... 00:00:16.275249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:16.754388 run create_hlr_db(pid=16002): Launched 00:00:16.913591 bus /gobi_6: Setting Powered False 00:00:17.973398 run create_hlr_db(pid=16002): Terminated: ok {rc=0} 00:00:18.408016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16004): Launched 00:00:18.726245 run osmo-hlr_10.42.42.2(pid=16005): Launched 00:00:18.848332 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:19.398379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16007): Launched 00:00:19.715962 run osmo-stp_10.42.42.5(pid=16008): Launched 00:00:19.838130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:20.385691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16010): Launched 00:00:20.506827 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:20.776049 run patchelf(pid=16011): Launched 00:00:20.953360 run osmo-stp_10.42.42.5(pid=16008): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16008)] 00:00:21.087959 run osmo-stp_10.42.42.5(pid=16008): stdout: | (launched: 2022-12-14_00:00:19.657599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:21.224145 run osmo-stp_10.42.42.5(pid=16008): stderr: | [0;m[38;5;43m20221214000019848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000019848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000019848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000019849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000019851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000019851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000019851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:21.360401 run osmo-stp_10.42.42.5(pid=16008): stdout: | (launched: 2022-12-14_00:00:19.657599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:21.491079 run osmo-stp_10.42.42.5(pid=16008): stderr: | [0;m[38;5;43m20221214000019848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000019848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000019848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000019849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000019851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000019851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000019851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:21.645534 run patchelf(pid=16011): Terminating (SIGINT) 00:00:21.824726 run patchelf(pid=16011): Terminated: ok {rc=0} 00:00:21.953254 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16008): Process ended prematurely: osmo-stp_10.42.42.5(pid=16008) [trial-2396↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16008)] [trial-2396↪gprs:trx-lms↪iperf3m4.py:8] 00:00:21.963357 tst iperf3m4.py:8: Test FAILED (10.6 sec) 00:00:21.992025 run osmo-hlr_10.42.42.2(pid=16005): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16005)] 00:00:22.042833 run osmo-hlr_10.42.42.2(pid=16005): stdout: | (launched: 2022-12-14_00:00:18.668081) 00:00:22.094854 run osmo-hlr_10.42.42.2(pid=16005): stderr: | [0;m[1;31m20221214000018866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000018866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000018866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000018866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000018866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000018866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000018880 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000018889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000018890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000018890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:22.147119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15993): Terminating (SIGTERM) 00:00:22.189499 run iperf3-srv_10.42.42.10(pid=15994): Terminating (SIGTERM) 00:00:22.231589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15996): Terminating (SIGTERM) 00:00:22.273533 run iperf3-srv_10.42.42.10(pid=15997): Terminating (SIGTERM) 00:00:22.315318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15998): Terminating (SIGTERM) 00:00:22.357121 run iperf3-srv_10.42.42.10(pid=15999): Terminating (SIGTERM) 00:00:22.398921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16000): Terminating (SIGTERM) 00:00:22.440765 run iperf3-srv_10.42.42.10(pid=16001): Terminating (SIGTERM) 00:00:22.482608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16004): Terminating (SIGTERM) 00:00:22.524458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16007): Terminating (SIGTERM) 00:00:22.566367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16010): Terminating (SIGTERM) 00:00:22.608477 --- ParallelTerminationStrategy: PID 15993 died... 00:00:22.628797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15993): Terminated: ok {rc=0} 00:00:22.675434 --- ParallelTerminationStrategy: PID 15994 died... 00:00:22.695217 run iperf3-srv_10.42.42.10(pid=15994): Terminated {rc=256} 00:00:22.741749 --- ParallelTerminationStrategy: PID 15996 died... 00:00:22.761666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15996): Terminated: ok {rc=0} 00:00:22.807930 --- ParallelTerminationStrategy: PID 15997 died... 00:00:22.827759 run iperf3-srv_10.42.42.10(pid=15997): Terminated {rc=256} 00:00:22.873886 --- ParallelTerminationStrategy: PID 15998 died... 00:00:22.893654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15998): Terminated: ok {rc=0} 00:00:22.939753 --- ParallelTerminationStrategy: PID 15999 died... 00:00:22.959485 run iperf3-srv_10.42.42.10(pid=15999): Terminated {rc=256} 00:00:23.005458 --- ParallelTerminationStrategy: PID 16000 died... 00:00:23.025267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16000): Terminated: ok {rc=0} 00:00:23.071349 --- ParallelTerminationStrategy: PID 16001 died... 00:00:23.091198 run iperf3-srv_10.42.42.10(pid=16001): Terminated {rc=256} 00:00:23.137360 --- ParallelTerminationStrategy: PID 16004 died... 00:00:23.157246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16004): Terminated: ok {rc=0} 00:00:23.203486 --- ParallelTerminationStrategy: PID 16007 died... 00:00:23.223394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16007): Terminated: ok {rc=0} 00:00:23.269743 --- ParallelTerminationStrategy: PID 16010 died... 00:00:23.289615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16010): Terminated: ok {rc=0} 00:00:23.378156 bus /gobi_4: Setting Powered False 00:00:24.478070 bus /gobi_4: Setting Powered False 00:00:25.594022 bus /gobi_1: Setting Powered False 00:00:26.691810 bus /gobi_1: Setting Powered False 00:00:27.808133 bus /gobi_0: Setting Powered False 00:00:28.904790 bus /gobi_0: Setting Powered False 00:00:30.024746 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms ping.py ---------------------------------------------- 00:00:31.124510 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:31.135771 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 00:00:31.190024 tst ping.py: using LAC 37140 00:00:31.341484 tst ping.py: using RAC 165 00:00:31.462750 tst ping.py: using CellId 37140 00:00:31.621463 tst ping.py: using BVCI 37141 00:00:31.738876 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:31.750323 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:31.761698 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:31.772853 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:31.785692 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:31.799231 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:31.812267 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:31.825245 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:31.947748 tst ping.py:19: start network... 00:00:32.163742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:32.649123 run create_hlr_db(pid=16012): Launched 00:00:32.768050 bus /gobi_6: Setting Powered False 00:00:33.830579 run create_hlr_db(pid=16012): Terminated: ok {rc=0} 00:00:34.249752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16014): Launched 00:00:34.561700 run osmo-hlr_10.42.42.2(pid=16015): Launched 00:00:34.680272 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:35.219783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16017): Launched 00:00:35.531773 run osmo-stp_10.42.42.5(pid=16018): Launched 00:00:35.651359 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:36.189902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16020): Launched 00:00:36.309181 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:36.573251 run patchelf(pid=16021): Launched 00:00:36.747639 run osmo-stp_10.42.42.5(pid=16018): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16018)] 00:00:36.880701 run osmo-stp_10.42.42.5(pid=16018): stdout: | (launched: 2022-12-14_00:00:35.475141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:37.015161 run osmo-stp_10.42.42.5(pid=16018): stderr: | [0;m[38;5;43m20221214000035667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000035667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000035667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000035667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000035668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000035668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000035668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:37.149608 run osmo-stp_10.42.42.5(pid=16018): stdout: | (launched: 2022-12-14_00:00:35.475141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:37.278219 run osmo-stp_10.42.42.5(pid=16018): stderr: | [0;m[38;5;43m20221214000035667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000035667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000035667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000035667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000035668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000035668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000035668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:37.430535 run patchelf(pid=16021): Terminating (SIGINT) 00:00:37.606478 run patchelf(pid=16021): Terminated: ok {rc=0} 00:00:37.733557 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16018): Process ended prematurely: osmo-stp_10.42.42.5(pid=16018) [trial-2396↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16018)] [trial-2396↪gprs:trx-lms↪ping.py:22] 00:00:37.742932 tst ping.py:22: Test FAILED (6.6 sec) 00:00:37.771059 run osmo-hlr_10.42.42.2(pid=16015): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16015)] 00:00:37.822070 run osmo-hlr_10.42.42.2(pid=16015): stdout: | (launched: 2022-12-14_00:00:34.505130) 00:00:37.874291 run osmo-hlr_10.42.42.2(pid=16015): stderr: | [0;m[1;31m20221214000034703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000034703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000034703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000034703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000034703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000034703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000034716 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000034724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000034724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000034725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:37.926934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16014): Terminating (SIGTERM) 00:00:37.969191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16017): Terminating (SIGTERM) 00:00:38.011292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16020): Terminating (SIGTERM) 00:00:38.053886 --- ParallelTerminationStrategy: PID 16014 died... 00:00:38.074602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16014): Terminated: ok {rc=0} 00:00:38.121483 --- ParallelTerminationStrategy: PID 16017 died... 00:00:38.141736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16017): Terminated: ok {rc=0} 00:00:38.188569 --- ParallelTerminationStrategy: PID 16020 died... 00:00:38.208815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16020): Terminated: ok {rc=0} 00:00:38.298228 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 00:00:39.386385 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:39.398066 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 00:00:39.450440 tst ping_idle_ping.py: using LAC 37141 00:00:39.566662 tst ping_idle_ping.py: using RAC 166 00:00:39.682090 tst ping_idle_ping.py: using CellId 37141 00:00:39.797297 tst ping_idle_ping.py: using BVCI 37142 00:00:39.903376 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:39.913966 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:39.924480 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:39.934859 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:39.945463 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:39.957859 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:39.969081 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:39.980070 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:40.094132 tst ping_idle_ping.py:24: start network... 00:00:40.293741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:40.749353 run create_hlr_db(pid=16022): Launched 00:00:40.868525 bus /gobi_6: Setting Powered False 00:00:41.928276 run create_hlr_db(pid=16022): Terminated: ok {rc=0} 00:00:42.357762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16024): Launched 00:00:42.671406 run osmo-hlr_10.42.42.2(pid=16025): Launched 00:00:42.792147 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:43.331091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16027): Launched 00:00:43.642806 run osmo-stp_10.42.42.5(pid=16028): Launched 00:00:43.762784 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:44.302833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16030): Launched 00:00:44.422605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:44.686626 run patchelf(pid=16031): Launched 00:00:44.861314 run osmo-stp_10.42.42.5(pid=16028): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16028)] 00:00:44.993980 run osmo-stp_10.42.42.5(pid=16028): stdout: | (launched: 2022-12-14_00:00:43.585952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:45.128438 run osmo-stp_10.42.42.5(pid=16028): stderr: | [0;m[38;5;43m20221214000043775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000043775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000043776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000043776 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000043778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000043778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000043778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:45.263190 run osmo-stp_10.42.42.5(pid=16028): stdout: | (launched: 2022-12-14_00:00:43.585952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:45.392036 run osmo-stp_10.42.42.5(pid=16028): stderr: | [0;m[38;5;43m20221214000043775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000043775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000043776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000043776 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000043778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000043778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000043778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:45.544581 run patchelf(pid=16031): Terminating (SIGINT) 00:00:45.720614 run patchelf(pid=16031): Terminated: ok {rc=0} 00:00:45.848770 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16028): Process ended prematurely: osmo-stp_10.42.42.5(pid=16028) [trial-2396↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16028)] [trial-2396↪gprs:trx-lms↪ping_idle_ping.py:27] 00:00:45.859005 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 00:00:45.888475 run osmo-hlr_10.42.42.2(pid=16025): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16025)] 00:00:45.954861 run osmo-hlr_10.42.42.2(pid=16025): stdout: | (launched: 2022-12-14_00:00:42.614340) 00:00:46.009613 run osmo-hlr_10.42.42.2(pid=16025): stderr: | [0;m[1;31m20221214000042810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000042810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000042810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000042810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000042810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000042810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000042822 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000042833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000042833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000042833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:46.063176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16024): Terminating (SIGTERM) 00:00:46.105378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16027): Terminating (SIGTERM) 00:00:46.149630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16030): Terminating (SIGTERM) 00:00:46.193457 --- ParallelTerminationStrategy: PID 16024 died... 00:00:46.213837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16024): Terminated: ok {rc=0} 00:00:46.261676 --- ParallelTerminationStrategy: PID 16027 died... 00:00:46.280819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16027): Terminated: ok {rc=0} 00:00:46.327019 --- ParallelTerminationStrategy: PID 16030 died... 00:00:46.346582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16030): Terminated: ok {rc=0} 00:00:46.434021 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 00:00:47.738800 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:00:47.744525 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:00:47.778251 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:00:47.819026 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:00:47.908016 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:00:47.941764 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:00:47.981656 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:00:48.574672 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:00:48.627005 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:48.638484 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:00:48.695116 tst cs_paging_gprs_active.py: using LAC 37142 00:00:48.813543 tst cs_paging_gprs_active.py: using RAC 167 00:00:48.939146 tst cs_paging_gprs_active.py: using CellId 37142 00:00:49.064240 tst cs_paging_gprs_active.py: using BVCI 37143 00:00:49.180335 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.191933 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.203223 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.214621 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.226307 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.238095 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.249953 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.261613 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.273539 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:00:49.393225 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:00:49.510548 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:00:49.711537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:50.012073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16035): Launched 00:00:50.274048 run iperf3-srv_10.42.42.10(pid=16036): Launched 00:00:50.386007 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:00:50.587423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:50.888037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16037): Launched 00:00:51.148771 run iperf3-srv_10.42.42.10(pid=16038): Launched 00:00:51.260727 tst cs_paging_gprs_active.py:38: start network... 00:00:51.461436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:51.923075 run create_hlr_db(pid=16043): Launched 00:00:52.046479 bus /gobi_6: Setting Powered False 00:00:53.106675 run create_hlr_db(pid=16043): Terminated: ok {rc=0} 00:00:53.541999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16047): Launched 00:00:53.861095 run osmo-hlr_10.42.42.2(pid=16048): Launched 00:00:53.982944 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:54.532248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16050): Launched 00:00:54.850707 run osmo-stp_10.42.42.5(pid=16051): Launched 00:00:54.972509 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:55.521094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16053): Launched 00:00:55.643467 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:55.912751 run patchelf(pid=16054): Launched 00:00:56.081099 run osmo-stp_10.42.42.5(pid=16051): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16051)] 00:00:56.208837 run osmo-stp_10.42.42.5(pid=16051): stdout: | (launched: 2022-12-14_00:00:54.793030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:56.337699 run osmo-stp_10.42.42.5(pid=16051): stderr: | [0;m[38;5;43m20221214000054983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000054983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000054984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000054984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000054986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000054987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000054987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:56.466675 run osmo-stp_10.42.42.5(pid=16051): stdout: | (launched: 2022-12-14_00:00:54.793030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:56.589520 run osmo-stp_10.42.42.5(pid=16051): stderr: | [0;m[38;5;43m20221214000054983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000054983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000054984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000054984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000054986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000054987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000054987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:56.735028 run patchelf(pid=16054): Terminating (SIGINT) 00:00:56.903178 run patchelf(pid=16054): Terminated: ok {rc=0} 00:00:57.024262 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16051): Process ended prematurely: osmo-stp_10.42.42.5(pid=16051) [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16051)] [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:00:57.033771 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 00:00:57.060619 run osmo-hlr_10.42.42.2(pid=16048): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16048)] 00:00:57.108578 run osmo-hlr_10.42.42.2(pid=16048): stdout: | (launched: 2022-12-14_00:00:53.803570) 00:00:57.158065 run osmo-hlr_10.42.42.2(pid=16048): stderr: | [0;m[1;31m20221214000054001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000054001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000054001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000054002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000054002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000054002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000054014 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000054022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000054022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000054022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:57.207828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16035): Terminating (SIGTERM) 00:00:57.247613 run iperf3-srv_10.42.42.10(pid=16036): Terminating (SIGTERM) 00:00:57.286961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16037): Terminating (SIGTERM) 00:00:57.326380 run iperf3-srv_10.42.42.10(pid=16038): Terminating (SIGTERM) 00:00:57.365805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16047): Terminating (SIGTERM) 00:00:57.405283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16050): Terminating (SIGTERM) 00:00:57.445299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16053): Terminating (SIGTERM) 00:00:57.485643 --- ParallelTerminationStrategy: PID 16035 died... 00:00:57.504674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16035): Terminated: ok {rc=0} 00:00:57.548348 --- ParallelTerminationStrategy: PID 16036 died... 00:00:57.566918 run iperf3-srv_10.42.42.10(pid=16036): Terminated {rc=256} 00:00:57.610259 --- ParallelTerminationStrategy: PID 16037 died... 00:00:57.629018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16037): Terminated: ok {rc=0} 00:00:57.672661 --- ParallelTerminationStrategy: PID 16038 died... 00:00:57.691356 run iperf3-srv_10.42.42.10(pid=16038): Terminated {rc=256} 00:00:57.734881 --- ParallelTerminationStrategy: PID 16047 died... 00:00:57.753580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16047): Terminated: ok {rc=0} 00:00:57.797212 --- ParallelTerminationStrategy: PID 16050 died... 00:00:57.815644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16050): Terminated: ok {rc=0} 00:00:57.859159 --- ParallelTerminationStrategy: PID 16053 died... 00:00:57.877802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16053): Terminated: ok {rc=0} 00:00:57.962793 bus /gobi_0: Setting Powered False 00:00:59.062680 bus /gobi_0: Setting Powered False 00:01:00.177453 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:01:01.330205 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.342981 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:01:01.396923 tst iperf3.py: using LAC 37143 00:01:01.516234 tst iperf3.py: using RAC 168 00:01:01.634521 tst iperf3.py: using CellId 37143 00:01:01.755737 tst iperf3.py: using BVCI 37144 00:01:01.876483 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.889344 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.901443 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.914579 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.927708 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.940798 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.954378 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.967375 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.980660 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:02.105947 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:01:02.334400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:02.653688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16055): Launched 00:01:02.929676 run iperf3-srv_10.42.42.10(pid=16056): Launched 00:01:03.049362 tst iperf3.py:8: start network... 00:01:03.264201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:03.756357 run create_hlr_db(pid=16057): Launched 00:01:03.876897 bus /gobi_6: Setting Powered False 00:01:04.940016 run create_hlr_db(pid=16057): Terminated: ok {rc=0} 00:01:05.382578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16059): Launched 00:01:05.699186 run osmo-hlr_10.42.42.2(pid=16060): Launched 00:01:05.821643 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:06.374841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16062): Launched 00:01:06.691786 run osmo-stp_10.42.42.5(pid=16063): Launched 00:01:06.814188 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:07.361079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16065): Launched 00:01:07.482657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:07.750782 run patchelf(pid=16066): Launched 00:01:07.928019 run osmo-stp_10.42.42.5(pid=16063): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16063)] 00:01:08.062441 run osmo-stp_10.42.42.5(pid=16063): stdout: | (launched: 2022-12-14_00:01:06.634221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:08.199136 run osmo-stp_10.42.42.5(pid=16063): stderr: | [0;m[38;5;43m20221214000106826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000106826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000106826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000106826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000106827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000106827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000106827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:08.335849 run osmo-stp_10.42.42.5(pid=16063): stdout: | (launched: 2022-12-14_00:01:06.634221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:08.466848 run osmo-stp_10.42.42.5(pid=16063): stderr: | [0;m[38;5;43m20221214000106826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000106826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000106826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000106826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000106827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000106827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000106827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:08.621260 run patchelf(pid=16066): Terminating (SIGINT) 00:01:08.799947 run patchelf(pid=16066): Terminated: ok {rc=0} 00:01:08.928524 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16063): Process ended prematurely: osmo-stp_10.42.42.5(pid=16063) [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16063)] [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 00:01:08.938576 tst iperf3.py:8: Test FAILED (7.6 sec) 00:01:08.966806 run osmo-hlr_10.42.42.2(pid=16060): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16060)] 00:01:09.017061 run osmo-hlr_10.42.42.2(pid=16060): stdout: | (launched: 2022-12-14_00:01:05.641729) 00:01:09.068445 run osmo-hlr_10.42.42.2(pid=16060): stderr: | [0;m[1;31m20221214000105839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000105839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000105839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000105839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000105839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000105839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000105854 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000105864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000105864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000105864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:09.120864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16055): Terminating (SIGTERM) 00:01:09.162413 run iperf3-srv_10.42.42.10(pid=16056): Terminating (SIGTERM) 00:01:09.203850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16059): Terminating (SIGTERM) 00:01:09.245539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16062): Terminating (SIGTERM) 00:01:09.287247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16065): Terminating (SIGTERM) 00:01:09.329170 --- ParallelTerminationStrategy: PID 16055 died... 00:01:09.349411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16055): Terminated: ok {rc=0} 00:01:09.395378 --- ParallelTerminationStrategy: PID 16056 died... 00:01:09.415092 run iperf3-srv_10.42.42.10(pid=16056): Terminated {rc=256} 00:01:09.460926 --- ParallelTerminationStrategy: PID 16059 died... 00:01:09.480912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16059): Terminated: ok {rc=0} 00:01:09.526619 --- ParallelTerminationStrategy: PID 16062 died... 00:01:09.546422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16062): Terminated: ok {rc=0} 00:01:09.592370 --- ParallelTerminationStrategy: PID 16065 died... 00:01:09.612068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16065): Terminated: ok {rc=0} 00:01:09.699317 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:01:10.844868 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:10.859090 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:01:10.907231 tst iperf3m4.py: using LAC 37144 00:01:11.025139 tst iperf3m4.py: using RAC 169 00:01:11.142367 tst iperf3m4.py: using CellId 37144 00:01:11.260916 tst iperf3m4.py: using BVCI 37145 00:01:11.368487 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:11.379322 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:11.389858 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:11.400289 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:11.410680 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:11.421161 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:11.431796 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:11.442321 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:11.452896 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:11.574397 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:11.691839 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:11.812564 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:11.934490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:01:12.149343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:12.467859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16067): Launched 00:01:12.743815 run iperf3-srv_10.42.42.10(pid=16068): Launched 00:01:12.863138 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:01:13.077621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:13.396614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16069): Launched 00:01:13.672225 run iperf3-srv_10.42.42.10(pid=16070): Launched 00:01:13.791807 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:01:14.005793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:14.325161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16071): Launched 00:01:14.600515 run iperf3-srv_10.42.42.10(pid=16072): Launched 00:01:14.719807 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:01:14.934838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:15.253777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16073): Launched 00:01:15.529216 run iperf3-srv_10.42.42.10(pid=16074): Launched 00:01:15.648321 tst iperf3m4.py:8: start network... 00:01:15.864016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:16.372863 run create_hlr_db(pid=16075): Launched 00:01:16.513810 bus /gobi_6: Setting Powered False 00:01:17.577382 run create_hlr_db(pid=16075): Terminated: ok {rc=0} 00:01:18.002865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16077): Launched 00:01:18.302148 run osmo-hlr_10.42.42.2(pid=16078): Launched 00:01:18.415761 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:18.947491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16080): Launched 00:01:19.245695 run osmo-stp_10.42.42.5(pid=16081): Launched 00:01:19.359623 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:19.874455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16083): Launched 00:01:19.988102 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:20.240073 run patchelf(pid=16084): Launched 00:01:20.407115 run osmo-stp_10.42.42.5(pid=16081): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16081)] 00:01:20.534502 run osmo-stp_10.42.42.5(pid=16081): stdout: | (launched: 2022-12-14_00:01:19.191163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:20.662394 run osmo-stp_10.42.42.5(pid=16081): stderr: | [0;m[38;5;43m20221214000119359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000119359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000119360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000119360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000119362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000119363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000119363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:20.790899 run osmo-stp_10.42.42.5(pid=16081): stdout: | (launched: 2022-12-14_00:01:19.191163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:20.913223 run osmo-stp_10.42.42.5(pid=16081): stderr: | [0;m[38;5;43m20221214000119359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000119359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000119360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000119360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000119362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000119363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000119363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:21.058903 run patchelf(pid=16084): Terminating (SIGINT) 00:01:21.228012 run patchelf(pid=16084): Terminated: ok {rc=0} 00:01:21.348923 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16081): Process ended prematurely: osmo-stp_10.42.42.5(pid=16081) [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16081)] [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 00:01:21.358561 tst iperf3m4.py:8: Test FAILED (10.5 sec) 00:01:21.385995 run osmo-hlr_10.42.42.2(pid=16078): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16078)] 00:01:21.434316 run osmo-hlr_10.42.42.2(pid=16078): stdout: | (launched: 2022-12-14_00:01:18.246871) 00:01:21.483926 run osmo-hlr_10.42.42.2(pid=16078): stderr: | [0;m[1;31m20221214000118424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000118424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000118424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000118424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000118424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000118424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000118436 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000118445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000118445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000118446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:21.534053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16067): Terminating (SIGTERM) 00:01:21.574278 run iperf3-srv_10.42.42.10(pid=16068): Terminating (SIGTERM) 00:01:21.614413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16069): Terminating (SIGTERM) 00:01:21.654873 run iperf3-srv_10.42.42.10(pid=16070): Terminating (SIGTERM) 00:01:21.695316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16071): Terminating (SIGTERM) 00:01:21.735454 run iperf3-srv_10.42.42.10(pid=16072): Terminating (SIGTERM) 00:01:21.775733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16073): Terminating (SIGTERM) 00:01:21.816033 run iperf3-srv_10.42.42.10(pid=16074): Terminating (SIGTERM) 00:01:21.855924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16077): Terminating (SIGTERM) 00:01:21.921209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16080): Terminating (SIGTERM) 00:01:21.961275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16083): Terminating (SIGTERM) 00:01:22.001932 --- ParallelTerminationStrategy: PID 16067 died... 00:01:22.021286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16067): Terminated: ok {rc=0} 00:01:22.065496 --- ParallelTerminationStrategy: PID 16068 died... 00:01:22.084047 run iperf3-srv_10.42.42.10(pid=16068): Terminated {rc=256} 00:01:22.128033 --- ParallelTerminationStrategy: PID 16069 died... 00:01:22.146842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16069): Terminated: ok {rc=0} 00:01:22.190441 --- ParallelTerminationStrategy: PID 16070 died... 00:01:22.209176 run iperf3-srv_10.42.42.10(pid=16070): Terminated {rc=256} 00:01:22.253081 --- ParallelTerminationStrategy: PID 16071 died... 00:01:22.272021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16071): Terminated: ok {rc=0} 00:01:22.316543 --- ParallelTerminationStrategy: PID 16072 died... 00:01:22.335266 run iperf3-srv_10.42.42.10(pid=16072): Terminated {rc=256} 00:01:22.378813 --- ParallelTerminationStrategy: PID 16073 died... 00:01:22.397364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16073): Terminated: ok {rc=0} 00:01:22.441121 --- ParallelTerminationStrategy: PID 16074 died... 00:01:22.459757 run iperf3-srv_10.42.42.10(pid=16074): Terminated {rc=256} 00:01:22.503326 --- ParallelTerminationStrategy: PID 16077 died... 00:01:22.522468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16077): Terminated: ok {rc=0} 00:01:22.566135 --- ParallelTerminationStrategy: PID 16080 died... 00:01:22.584755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16080): Terminated: ok {rc=0} 00:01:22.628526 --- ParallelTerminationStrategy: PID 16083 died... 00:01:22.647315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16083): Terminated: ok {rc=0} 00:01:22.730466 bus /gobi_4: Setting Powered False 00:01:23.827890 bus /gobi_4: Setting Powered False 00:01:24.940447 bus /gobi_1: Setting Powered False 00:01:26.038055 bus /gobi_1: Setting Powered False 00:01:27.154271 bus /gobi_0: Setting Powered False 00:01:28.251502 bus /gobi_0: Setting Powered False 00:01:29.366945 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 00:01:30.469015 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:30.480722 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:01:30.531602 tst ping.py: using LAC 37145 00:01:30.658427 tst ping.py: using RAC 170 00:01:30.780435 tst ping.py: using CellId 37145 00:01:30.910930 tst ping.py: using BVCI 37146 00:01:31.028266 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:31.039965 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:31.052878 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:31.064283 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:31.076815 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:31.090088 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:31.103628 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:31.116929 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:31.242859 tst ping.py:19: start network... 00:01:31.460379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:31.956031 run create_hlr_db(pid=16085): Launched 00:01:32.110032 bus /gobi_6: Setting Powered False 00:01:33.168828 run create_hlr_db(pid=16085): Terminated: ok {rc=0} 00:01:33.605136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16087): Launched 00:01:33.917030 run osmo-hlr_10.42.42.2(pid=16088): Launched 00:01:34.035841 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:34.576430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16090): Launched 00:01:34.887658 run osmo-stp_10.42.42.5(pid=16091): Launched 00:01:35.006967 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:35.545655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16093): Launched 00:01:35.664206 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:35.928283 run patchelf(pid=16094): Launched 00:01:36.101214 run osmo-stp_10.42.42.5(pid=16091): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16091)] 00:01:36.233910 run osmo-stp_10.42.42.5(pid=16091): stdout: | (launched: 2022-12-14_00:01:34.831104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:36.367981 run osmo-stp_10.42.42.5(pid=16091): stderr: | [0;m[38;5;43m20221214000135021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000135021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000135021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000135022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000135022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000135022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000135022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:36.502770 run osmo-stp_10.42.42.5(pid=16091): stdout: | (launched: 2022-12-14_00:01:34.831104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:36.631298 run osmo-stp_10.42.42.5(pid=16091): stderr: | [0;m[38;5;43m20221214000135021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000135021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000135021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000135022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000135022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000135022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000135022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:36.783711 run patchelf(pid=16094): Terminating (SIGINT) 00:01:36.958357 run patchelf(pid=16094): Terminated: ok {rc=0} 00:01:37.084149 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16091): Process ended prematurely: osmo-stp_10.42.42.5(pid=16091) [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16091)] [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 00:01:37.093732 tst ping.py:22: Test FAILED (6.6 sec) 00:01:37.121676 run osmo-hlr_10.42.42.2(pid=16088): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16088)] 00:01:37.172919 run osmo-hlr_10.42.42.2(pid=16088): stdout: | (launched: 2022-12-14_00:01:33.860261) 00:01:37.225256 run osmo-hlr_10.42.42.2(pid=16088): stderr: | [0;m[1;31m20221214000134057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000134057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000134057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000134057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000134057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000134057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000134069 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000134077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000134078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000134078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:37.277827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16087): Terminating (SIGTERM) 00:01:37.319930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16090): Terminating (SIGTERM) 00:01:37.362190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16093): Terminating (SIGTERM) 00:01:37.404633 --- ParallelTerminationStrategy: PID 16087 died... 00:01:37.425122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16087): Terminated: ok {rc=0} 00:01:37.471605 --- ParallelTerminationStrategy: PID 16090 died... 00:01:37.491571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16090): Terminated: ok {rc=0} 00:01:37.538173 --- ParallelTerminationStrategy: PID 16093 died... 00:01:37.558219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16093): Terminated: ok {rc=0} 00:01:37.646617 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:01:38.734240 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:38.746344 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:01:38.802418 tst ping_idle_ping.py: using LAC 37146 00:01:38.917270 tst ping_idle_ping.py: using RAC 171 00:01:39.030646 tst ping_idle_ping.py: using CellId 37146 00:01:39.143992 tst ping_idle_ping.py: using BVCI 37147 00:01:39.250388 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:39.261493 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:39.272227 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:39.283106 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:39.293803 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:39.304696 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:39.315859 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:39.326783 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:39.440841 tst ping_idle_ping.py:24: start network... 00:01:39.637868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:40.094134 run create_hlr_db(pid=16095): Launched 00:01:40.213953 bus /gobi_6: Setting Powered False 00:01:41.273482 run create_hlr_db(pid=16095): Terminated: ok {rc=0} 00:01:41.684848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16097): Launched 00:01:41.977436 run osmo-hlr_10.42.42.2(pid=16098): Launched 00:01:42.088904 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:42.593969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16100): Launched 00:01:42.887221 run osmo-stp_10.42.42.5(pid=16101): Launched 00:01:42.998480 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:43.504001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16103): Launched 00:01:43.616214 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:43.865054 run patchelf(pid=16104): Launched 00:01:44.028094 run osmo-stp_10.42.42.5(pid=16101): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16101)] 00:01:44.152164 run osmo-stp_10.42.42.5(pid=16101): stdout: | (launched: 2022-12-14_00:01:42.833260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:44.277999 run osmo-stp_10.42.42.5(pid=16101): stderr: | [0;m[38;5;43m20221214000143003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000143003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000143003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000143004 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000143004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000143004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000143004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:44.403619 run osmo-stp_10.42.42.5(pid=16101): stdout: | (launched: 2022-12-14_00:01:42.833260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:44.524556 run osmo-stp_10.42.42.5(pid=16101): stderr: | [0;m[38;5;43m20221214000143003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000143003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000143003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000143004 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000143004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000143004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000143004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:44.667090 run patchelf(pid=16104): Terminating (SIGINT) 00:01:44.831227 run patchelf(pid=16104): Terminated: ok {rc=0} 00:01:44.949561 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16101): Process ended prematurely: osmo-stp_10.42.42.5(pid=16101) [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16101)] [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 00:01:44.958165 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 00:01:44.984579 run osmo-hlr_10.42.42.2(pid=16098): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16098)] 00:01:45.032827 run osmo-hlr_10.42.42.2(pid=16098): stdout: | (launched: 2022-12-14_00:01:41.923731) 00:01:45.082526 run osmo-hlr_10.42.42.2(pid=16098): stderr: | [0;m[1;31m20221214000142103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000142103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000142103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000142103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000142103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000142103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000142115 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000142123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000142123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000142123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:45.132337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16097): Terminating (SIGTERM) 00:01:45.171802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16100): Terminating (SIGTERM) 00:01:45.211238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16103): Terminating (SIGTERM) 00:01:45.250909 --- ParallelTerminationStrategy: PID 16097 died... 00:01:45.270262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16097): Terminated: ok {rc=0} 00:01:45.314203 --- ParallelTerminationStrategy: PID 16100 died... 00:01:45.332842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16100): Terminated: ok {rc=0} 00:01:45.376814 --- ParallelTerminationStrategy: PID 16103 died... 00:01:45.396080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16103): Terminated: ok {rc=0} 00:01:45.480029 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:01:46.790009 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:01:46.799313 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:01:46.835434 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:01:46.876393 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:01:46.970353 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:01:47.014487 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:01:47.087021 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:01:47.639119 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:01:47.691941 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:47.703393 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:01:47.774323 tst cs_paging_gprs_active.py: using LAC 37147 00:01:47.899931 tst cs_paging_gprs_active.py: using RAC 172 00:01:48.023468 tst cs_paging_gprs_active.py: using CellId 37147 00:01:48.147271 tst cs_paging_gprs_active.py: using BVCI 37148 00:01:48.263484 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.274849 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.285966 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.297060 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.308835 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.321212 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.333313 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.345198 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.357311 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:01:48.476196 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:01:48.592206 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:01:48.809689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:49.129633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16108): Launched 00:01:49.406511 run iperf3-srv_10.42.42.10(pid=16109): Launched 00:01:49.526303 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:01:49.742043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:50.063228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16110): Launched 00:01:50.340072 run iperf3-srv_10.42.42.10(pid=16111): Launched 00:01:50.459332 tst cs_paging_gprs_active.py:38: start network... 00:01:50.674032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:51.167890 run create_hlr_db(pid=16112): Launched 00:01:51.288750 bus /gobi_6: Setting Powered False 00:01:52.352485 run create_hlr_db(pid=16112): Terminated: ok {rc=0} 00:01:52.795352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16114): Launched 00:01:53.114255 run osmo-hlr_10.42.42.2(pid=16115): Launched 00:01:53.236395 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:53.782338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16117): Launched 00:01:54.099812 run osmo-stp_10.42.42.5(pid=16118): Launched 00:01:54.221542 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:54.771063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16120): Launched 00:01:54.893314 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:55.168774 run patchelf(pid=16121): Launched 00:01:55.346190 run osmo-stp_10.42.42.5(pid=16118): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16118)] 00:01:55.481084 run osmo-stp_10.42.42.5(pid=16118): stdout: | (launched: 2022-12-14_00:01:54.042039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:55.617778 run osmo-stp_10.42.42.5(pid=16118): stderr: | [0;m[38;5;43m20221214000154231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000154232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000154232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000154232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000154235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000154235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000154235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:55.754840 run osmo-stp_10.42.42.5(pid=16118): stdout: | (launched: 2022-12-14_00:01:54.042039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:55.885320 run osmo-stp_10.42.42.5(pid=16118): stderr: | [0;m[38;5;43m20221214000154231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000154232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000154232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000154232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000154235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000154235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000154235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:56.039990 run patchelf(pid=16121): Terminating (SIGINT) 00:01:56.218968 run patchelf(pid=16121): Terminated: ok {rc=0} 00:01:56.347761 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16118): Process ended prematurely: osmo-stp_10.42.42.5(pid=16118) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16118)] [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:01:56.357830 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 00:01:56.386085 run osmo-hlr_10.42.42.2(pid=16115): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16115)] 00:01:56.436329 run osmo-hlr_10.42.42.2(pid=16115): stdout: | (launched: 2022-12-14_00:01:53.055898) 00:01:56.487944 run osmo-hlr_10.42.42.2(pid=16115): stderr: | [0;m[1;31m20221214000153254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000153254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000153254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000153254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000153254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000153254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000153267 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000153275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000153275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000153275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:56.539904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16108): Terminating (SIGTERM) 00:01:56.581827 run iperf3-srv_10.42.42.10(pid=16109): Terminating (SIGTERM) 00:01:56.623519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16110): Terminating (SIGTERM) 00:01:56.665305 run iperf3-srv_10.42.42.10(pid=16111): Terminating (SIGTERM) 00:01:56.706810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16114): Terminating (SIGTERM) 00:01:56.748593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16117): Terminating (SIGTERM) 00:01:56.790294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16120): Terminating (SIGTERM) 00:01:56.832249 --- ParallelTerminationStrategy: PID 16108 died... 00:01:56.852566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16108): Terminated: ok {rc=0} 00:01:56.898711 --- ParallelTerminationStrategy: PID 16109 died... 00:01:56.918431 run iperf3-srv_10.42.42.10(pid=16109): Terminated {rc=256} 00:01:56.964050 --- ParallelTerminationStrategy: PID 16110 died... 00:01:56.983794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16110): Terminated: ok {rc=0} 00:01:57.029975 --- ParallelTerminationStrategy: PID 16111 died... 00:01:57.049646 run iperf3-srv_10.42.42.10(pid=16111): Terminated {rc=256} 00:01:57.095362 --- ParallelTerminationStrategy: PID 16114 died... 00:01:57.115136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16114): Terminated: ok {rc=0} 00:01:57.160870 --- ParallelTerminationStrategy: PID 16117 died... 00:01:57.180925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16117): Terminated: ok {rc=0} 00:01:57.226877 --- ParallelTerminationStrategy: PID 16120 died... 00:01:57.246652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16120): Terminated: ok {rc=0} 00:01:57.334041 bus /gobi_0: Setting Powered False 00:01:58.432617 bus /gobi_0: Setting Powered False 00:01:59.546015 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:02:00.694538 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:00.706485 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:02:00.778474 tst iperf3.py: using LAC 37148 00:02:00.927584 tst iperf3.py: using RAC 173 00:02:01.054959 tst iperf3.py: using CellId 37148 00:02:01.180375 tst iperf3.py: using BVCI 37149 00:02:01.339517 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.352059 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.364297 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.376460 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.390013 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.403277 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.416640 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.429845 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.443120 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:01.565965 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:02:01.843566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:02.174814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16122): Launched 00:02:02.464246 run iperf3-srv_10.42.42.10(pid=16123): Launched 00:02:02.584604 tst iperf3.py:8: start network... 00:02:02.800836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:03.293272 run create_hlr_db(pid=16124): Launched 00:02:03.415320 bus /gobi_6: Setting Powered False 00:02:04.478279 run create_hlr_db(pid=16124): Terminated: ok {rc=0} 00:02:04.904049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16126): Launched 00:02:05.201086 run osmo-hlr_10.42.42.2(pid=16127): Launched 00:02:05.314210 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:05.827535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16129): Launched 00:02:06.125059 run osmo-stp_10.42.42.5(pid=16130): Launched 00:02:06.238576 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:06.752633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16132): Launched 00:02:06.866610 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:07.118563 run patchelf(pid=16133): Launched 00:02:07.284203 run osmo-stp_10.42.42.5(pid=16130): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16130)] 00:02:07.410982 run osmo-stp_10.42.42.5(pid=16130): stdout: | (launched: 2022-12-14_00:02:06.070371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:07.539337 run osmo-stp_10.42.42.5(pid=16130): stderr: | [0;m[38;5;43m20221214000206239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000206239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000206239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000206240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000206242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000206242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000206242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:07.667448 run osmo-stp_10.42.42.5(pid=16130): stdout: | (launched: 2022-12-14_00:02:06.070371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:07.789540 run osmo-stp_10.42.42.5(pid=16130): stderr: | [0;m[38;5;43m20221214000206239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000206239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000206239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000206240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000206242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000206242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000206242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:07.934542 run patchelf(pid=16133): Terminating (SIGINT) 00:02:08.103003 run patchelf(pid=16133): Terminated: ok {rc=0} 00:02:08.224296 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16130): Process ended prematurely: osmo-stp_10.42.42.5(pid=16130) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16130)] [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 00:02:08.233807 tst iperf3.py:8: Test FAILED (7.6 sec) 00:02:08.260678 run osmo-hlr_10.42.42.2(pid=16127): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16127)] 00:02:08.308511 run osmo-hlr_10.42.42.2(pid=16127): stdout: | (launched: 2022-12-14_00:02:05.146593) 00:02:08.358175 run osmo-hlr_10.42.42.2(pid=16127): stderr: | [0;m[1;31m20221214000205323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000205323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000205323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000205323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000205323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000205323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000205335 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000205344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000205345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000205345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:08.408159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16122): Terminating (SIGTERM) 00:02:08.448009 run iperf3-srv_10.42.42.10(pid=16123): Terminating (SIGTERM) 00:02:08.487614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16126): Terminating (SIGTERM) 00:02:08.527370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16129): Terminating (SIGTERM) 00:02:08.566881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16132): Terminating (SIGTERM) 00:02:08.606762 --- ParallelTerminationStrategy: PID 16122 died... 00:02:08.626139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16122): Terminated: ok {rc=0} 00:02:08.670724 --- ParallelTerminationStrategy: PID 16123 died... 00:02:08.689651 run iperf3-srv_10.42.42.10(pid=16123): Terminated {rc=256} 00:02:08.733229 --- ParallelTerminationStrategy: PID 16126 died... 00:02:08.751798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16126): Terminated: ok {rc=0} 00:02:08.795810 --- ParallelTerminationStrategy: PID 16129 died... 00:02:08.814519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16129): Terminated: ok {rc=0} 00:02:08.858060 --- ParallelTerminationStrategy: PID 16132 died... 00:02:08.877040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16132): Terminated: ok {rc=0} 00:02:08.960249 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:02:10.101674 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:10.113252 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:02:10.183554 tst iperf3m4.py: using LAC 37149 00:02:10.301490 tst iperf3m4.py: using RAC 174 00:02:10.419041 tst iperf3m4.py: using CellId 37149 00:02:10.536571 tst iperf3m4.py: using BVCI 37150 00:02:10.645210 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:10.656212 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:10.667458 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:10.678325 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:10.689355 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:10.700144 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:10.711518 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:10.722596 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:10.733724 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:10.849525 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:10.969992 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:11.089047 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:11.206622 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:02:11.408002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:11.708813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16134): Launched 00:02:11.968844 run iperf3-srv_10.42.42.10(pid=16135): Launched 00:02:12.080657 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:02:12.280880 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:12.581319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16136): Launched 00:02:12.841618 run iperf3-srv_10.42.42.10(pid=16137): Launched 00:02:12.953573 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:02:13.152915 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:13.452606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16138): Launched 00:02:13.712703 run iperf3-srv_10.42.42.10(pid=16139): Launched 00:02:13.834020 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:02:14.048803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:14.368570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16140): Launched 00:02:14.645305 run iperf3-srv_10.42.42.10(pid=16141): Launched 00:02:14.765598 tst iperf3m4.py:8: start network... 00:02:14.980244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:15.473411 run create_hlr_db(pid=16142): Launched 00:02:15.595439 bus /gobi_6: Setting Powered False 00:02:16.676198 run create_hlr_db(pid=16142): Terminated: ok {rc=0} 00:02:17.163862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16144): Launched 00:02:17.492707 run osmo-hlr_10.42.42.2(pid=16145): Launched 00:02:17.617188 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:18.166588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16147): Launched 00:02:18.483202 run osmo-stp_10.42.42.5(pid=16148): Launched 00:02:18.604283 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:19.152343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16150): Launched 00:02:19.274239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:19.542862 run patchelf(pid=16151): Launched 00:02:19.719866 run osmo-stp_10.42.42.5(pid=16148): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16148)] 00:02:19.855679 run osmo-stp_10.42.42.5(pid=16148): stdout: | (launched: 2022-12-14_00:02:18.425476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:19.992411 run osmo-stp_10.42.42.5(pid=16148): stderr: | [0;m[38;5;43m20221214000218618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000218618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000218618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000218619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000218619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000218619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000218620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:20.129309 run osmo-stp_10.42.42.5(pid=16148): stdout: | (launched: 2022-12-14_00:02:18.425476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:20.260009 run osmo-stp_10.42.42.5(pid=16148): stderr: | [0;m[38;5;43m20221214000218618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000218618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000218618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000218619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000218619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000218619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000218620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:20.415068 run patchelf(pid=16151): Terminating (SIGINT) 00:02:20.594099 run patchelf(pid=16151): Terminated: ok {rc=0} 00:02:20.722855 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16148): Process ended prematurely: osmo-stp_10.42.42.5(pid=16148) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16148)] [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:02:20.732775 tst iperf3m4.py:8: Test FAILED (10.7 sec) 00:02:20.762161 run osmo-hlr_10.42.42.2(pid=16145): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16145)] 00:02:20.813282 run osmo-hlr_10.42.42.2(pid=16145): stdout: | (launched: 2022-12-14_00:02:17.434917) 00:02:20.865422 run osmo-hlr_10.42.42.2(pid=16145): stderr: | [0;m[1;31m20221214000217630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000217630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000217630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000217630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000217631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000217631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000217643 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000217652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000217652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000217652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:20.917914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16134): Terminating (SIGTERM) 00:02:20.960210 run iperf3-srv_10.42.42.10(pid=16135): Terminating (SIGTERM) 00:02:21.002504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16136): Terminating (SIGTERM) 00:02:21.044710 run iperf3-srv_10.42.42.10(pid=16137): Terminating (SIGTERM) 00:02:21.086645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16138): Terminating (SIGTERM) 00:02:21.128858 run iperf3-srv_10.42.42.10(pid=16139): Terminating (SIGTERM) 00:02:21.170694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16140): Terminating (SIGTERM) 00:02:21.213298 run iperf3-srv_10.42.42.10(pid=16141): Terminating (SIGTERM) 00:02:21.255252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16144): Terminating (SIGTERM) 00:02:21.297318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16147): Terminating (SIGTERM) 00:02:21.339536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16150): Terminating (SIGTERM) 00:02:21.381965 --- ParallelTerminationStrategy: PID 16134 died... 00:02:21.402457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16134): Terminated: ok {rc=0} 00:02:21.449342 --- ParallelTerminationStrategy: PID 16135 died... 00:02:21.469398 run iperf3-srv_10.42.42.10(pid=16135): Terminated {rc=256} 00:02:21.515986 --- ParallelTerminationStrategy: PID 16136 died... 00:02:21.536018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16136): Terminated: ok {rc=0} 00:02:21.582646 --- ParallelTerminationStrategy: PID 16137 died... 00:02:21.602602 run iperf3-srv_10.42.42.10(pid=16137): Terminated {rc=256} 00:02:21.649113 --- ParallelTerminationStrategy: PID 16138 died... 00:02:21.668910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16138): Terminated: ok {rc=0} 00:02:21.715644 --- ParallelTerminationStrategy: PID 16139 died... 00:02:21.735541 run iperf3-srv_10.42.42.10(pid=16139): Terminated {rc=256} 00:02:21.782223 --- ParallelTerminationStrategy: PID 16140 died... 00:02:21.802117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16140): Terminated: ok {rc=0} 00:02:21.848687 --- ParallelTerminationStrategy: PID 16141 died... 00:02:21.868825 run iperf3-srv_10.42.42.10(pid=16141): Terminated {rc=256} 00:02:21.915075 --- ParallelTerminationStrategy: PID 16144 died... 00:02:21.934882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16144): Terminated: ok {rc=0} 00:02:21.981202 --- ParallelTerminationStrategy: PID 16147 died... 00:02:22.001199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16147): Terminated: ok {rc=0} 00:02:22.047533 --- ParallelTerminationStrategy: PID 16150 died... 00:02:22.067413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16150): Terminated: ok {rc=0} 00:02:22.155355 bus /gobi_4: Setting Powered False 00:02:23.253862 bus /gobi_4: Setting Powered False 00:02:24.368854 bus /gobi_1: Setting Powered False 00:02:25.467012 bus /gobi_1: Setting Powered False 00:02:26.584735 bus /gobi_0: Setting Powered False 00:02:27.682510 bus /gobi_0: Setting Powered False 00:02:28.798362 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:02:29.898297 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:29.909881 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:02:29.978479 tst ping.py: using LAC 37150 00:02:30.099723 tst ping.py: using RAC 175 00:02:30.212871 tst ping.py: using CellId 37150 00:02:30.325809 tst ping.py: using BVCI 37151 00:02:30.431161 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:30.442102 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:30.452688 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:30.463390 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:30.473955 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:30.484660 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:30.495448 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:30.506071 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:30.618407 tst ping.py:19: start network... 00:02:30.813587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:31.330809 run create_hlr_db(pid=16152): Launched 00:02:31.484694 bus /gobi_6: Setting Powered False 00:02:32.546862 run create_hlr_db(pid=16152): Terminated: ok {rc=0} 00:02:32.989230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16154): Launched 00:02:33.300196 run osmo-hlr_10.42.42.2(pid=16155): Launched 00:02:33.419476 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:33.963364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16157): Launched 00:02:34.274557 run osmo-stp_10.42.42.5(pid=16158): Launched 00:02:34.393358 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:34.933182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16160): Launched 00:02:35.052827 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:35.317270 run patchelf(pid=16161): Launched 00:02:35.491421 run osmo-stp_10.42.42.5(pid=16158): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16158)] 00:02:35.624060 run osmo-stp_10.42.42.5(pid=16158): stdout: | (launched: 2022-12-14_00:02:34.217712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:35.758030 run osmo-stp_10.42.42.5(pid=16158): stderr: | [0;m[38;5;43m20221214000234407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000234407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000234407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000234408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000234408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000234408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000234408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:35.892627 run osmo-stp_10.42.42.5(pid=16158): stdout: | (launched: 2022-12-14_00:02:34.217712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:36.021167 run osmo-stp_10.42.42.5(pid=16158): stderr: | [0;m[38;5;43m20221214000234407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000234407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000234407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000234408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000234408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000234408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000234408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:36.173273 run patchelf(pid=16161): Terminating (SIGINT) 00:02:36.347964 run patchelf(pid=16161): Terminated: ok {rc=0} 00:02:36.474237 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16158): Process ended prematurely: osmo-stp_10.42.42.5(pid=16158) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16158)] [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 00:02:36.483859 tst ping.py:22: Test FAILED (6.6 sec) 00:02:36.512324 run osmo-hlr_10.42.42.2(pid=16155): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16155)] 00:02:36.563218 run osmo-hlr_10.42.42.2(pid=16155): stdout: | (launched: 2022-12-14_00:02:33.243466) 00:02:36.615716 run osmo-hlr_10.42.42.2(pid=16155): stderr: | [0;m[1;31m20221214000233438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000233438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000233438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000233438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000233438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000233438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000233452 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000233462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000233462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000233462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:36.668404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16154): Terminating (SIGTERM) 00:02:36.710613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16157): Terminating (SIGTERM) 00:02:36.752785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16160): Terminating (SIGTERM) 00:02:36.795642 --- ParallelTerminationStrategy: PID 16154 died... 00:02:36.816316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16154): Terminated: ok {rc=0} 00:02:36.863052 --- ParallelTerminationStrategy: PID 16157 died... 00:02:36.883006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16157): Terminated: ok {rc=0} 00:02:36.929798 --- ParallelTerminationStrategy: PID 16160 died... 00:02:36.949929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16160): Terminated: ok {rc=0} 00:02:37.037744 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:02:38.125942 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:38.137728 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:02:38.207756 tst ping_idle_ping.py: using LAC 37151 00:02:38.322901 tst ping_idle_ping.py: using RAC 176 00:02:38.438227 tst ping_idle_ping.py: using CellId 37151 00:02:38.556114 tst ping_idle_ping.py: using BVCI 37152 00:02:38.663747 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:38.674677 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:38.685309 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:38.695986 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:38.706650 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:38.717355 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:38.727958 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:38.738570 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:38.850201 tst ping_idle_ping.py:24: start network... 00:02:39.048020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:39.506690 run create_hlr_db(pid=16162): Launched 00:02:39.626445 bus /gobi_6: Setting Powered False 00:02:40.686103 run create_hlr_db(pid=16162): Terminated: ok {rc=0} 00:02:41.117531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16164): Launched 00:02:41.430714 run osmo-hlr_10.42.42.2(pid=16165): Launched 00:02:41.550616 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:42.093943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16167): Launched 00:02:42.406580 run osmo-stp_10.42.42.5(pid=16168): Launched 00:02:42.526790 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:43.070950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16170): Launched 00:02:43.191045 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:43.456733 run patchelf(pid=16171): Launched 00:02:43.631717 run osmo-stp_10.42.42.5(pid=16168): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16168)] 00:02:43.765476 run osmo-stp_10.42.42.5(pid=16168): stdout: | (launched: 2022-12-14_00:02:42.349614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:43.901136 run osmo-stp_10.42.42.5(pid=16168): stderr: | [0;m[38;5;43m20221214000242540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000242540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000242541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000242541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000242541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000242542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000242542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:44.036325 run osmo-stp_10.42.42.5(pid=16168): stdout: | (launched: 2022-12-14_00:02:42.349614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:44.165688 run osmo-stp_10.42.42.5(pid=16168): stderr: | [0;m[38;5;43m20221214000242540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000242540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000242541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000242541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000242541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000242542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000242542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:44.318710 run patchelf(pid=16171): Terminating (SIGINT) 00:02:44.494789 run patchelf(pid=16171): Terminated: ok {rc=0} 00:02:44.621389 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16168): Process ended prematurely: osmo-stp_10.42.42.5(pid=16168) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16168)] [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:02:44.630920 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 00:02:44.658870 run osmo-hlr_10.42.42.2(pid=16165): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16165)] 00:02:44.709587 run osmo-hlr_10.42.42.2(pid=16165): stdout: | (launched: 2022-12-14_00:02:41.373571) 00:02:44.761757 run osmo-hlr_10.42.42.2(pid=16165): stderr: | [0;m[1;31m20221214000241571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000241571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000241571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000241571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000241571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000241571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000241588 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000241597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000241597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000241597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:44.814327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16164): Terminating (SIGTERM) 00:02:44.856771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16167): Terminating (SIGTERM) 00:02:44.899092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16170): Terminating (SIGTERM) 00:02:44.941519 --- ParallelTerminationStrategy: PID 16164 died... 00:02:44.962388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16164): Terminated: ok {rc=0} 00:02:45.008926 --- ParallelTerminationStrategy: PID 16167 died... 00:02:45.029263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16167): Terminated: ok {rc=0} 00:02:45.075698 --- ParallelTerminationStrategy: PID 16170 died... 00:02:45.095703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16170): Terminated: ok {rc=0} 00:02:45.183490 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:02:46.547543 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:02:46.556488 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:02:46.602309 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 00:02:46.641422 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 00:02:46.733146 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:02:46.786411 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 00:02:46.831588 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 00:02:47.405886 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 00:02:47.459071 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:47.470339 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:02:47.544365 tst cs_paging_gprs_active.py: using LAC 37152 00:02:47.671488 tst cs_paging_gprs_active.py: using RAC 177 00:02:47.798403 tst cs_paging_gprs_active.py: using CellId 37152 00:02:47.916857 tst cs_paging_gprs_active.py: using BVCI 37153 00:02:48.034990 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:48.046493 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:48.057783 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:48.068843 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:48.081124 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:48.092373 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:48.104198 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:48.117039 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:48.129284 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:02:48.249933 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:02:48.370757 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:02:48.570940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:48.870807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16175): Launched 00:02:49.132071 run iperf3-srv_10.42.42.10(pid=16176): Launched 00:02:49.243628 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:02:49.443480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:49.742994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16177): Launched 00:02:50.002586 run iperf3-srv_10.42.42.10(pid=16178): Launched 00:02:50.114287 tst cs_paging_gprs_active.py:38: start network... 00:02:50.314638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:50.777351 run create_hlr_db(pid=16179): Launched 00:02:50.901240 bus /gobi_6: Setting Powered False 00:02:51.965512 run create_hlr_db(pid=16179): Terminated: ok {rc=0} 00:02:52.408304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16181): Launched 00:02:52.728808 run osmo-hlr_10.42.42.2(pid=16182): Launched 00:02:52.851437 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:53.399480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16184): Launched 00:02:53.718802 run osmo-stp_10.42.42.5(pid=16185): Launched 00:02:53.842148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:54.393720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16187): Launched 00:02:54.516395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:54.786842 run patchelf(pid=16188): Launched 00:02:54.966629 run osmo-stp_10.42.42.5(pid=16185): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16185)] 00:02:55.102731 run osmo-stp_10.42.42.5(pid=16185): stdout: | (launched: 2022-12-14_00:02:53.660799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:55.240014 run osmo-stp_10.42.42.5(pid=16185): stderr: | [0;m[38;5;43m20221214000253854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000253854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000253854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000253854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000253855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000253855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000253855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:55.377999 run osmo-stp_10.42.42.5(pid=16185): stdout: | (launched: 2022-12-14_00:02:53.660799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:55.509398 run osmo-stp_10.42.42.5(pid=16185): stderr: | [0;m[38;5;43m20221214000253854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000253854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000253854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000253854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000253855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000253855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000253855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:55.665252 run patchelf(pid=16188): Terminating (SIGINT) 00:02:55.844421 run patchelf(pid=16188): Terminated: ok {rc=0} 00:02:55.973400 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16185): Process ended prematurely: osmo-stp_10.42.42.5(pid=16185) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16185)] [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 00:02:55.983421 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 00:02:56.011743 run osmo-hlr_10.42.42.2(pid=16182): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16182)] 00:02:56.062104 run osmo-hlr_10.42.42.2(pid=16182): stdout: | (launched: 2022-12-14_00:02:52.669943) 00:02:56.113782 run osmo-hlr_10.42.42.2(pid=16182): stderr: | [0;m[1;31m20221214000252869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000252869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000252869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000252869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000252869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000252869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000252880 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000252889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000252889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000252889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:56.165896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16175): Terminating (SIGTERM) 00:02:56.207722 run iperf3-srv_10.42.42.10(pid=16176): Terminating (SIGTERM) 00:02:56.249468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16177): Terminating (SIGTERM) 00:02:56.291110 run iperf3-srv_10.42.42.10(pid=16178): Terminating (SIGTERM) 00:02:56.332694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16181): Terminating (SIGTERM) 00:02:56.374450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16184): Terminating (SIGTERM) 00:02:56.416103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16187): Terminating (SIGTERM) 00:02:56.458282 --- ParallelTerminationStrategy: PID 16175 died... 00:02:56.478492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16175): Terminated: ok {rc=0} 00:02:56.525030 --- ParallelTerminationStrategy: PID 16176 died... 00:02:56.544585 run iperf3-srv_10.42.42.10(pid=16176): Terminated {rc=256} 00:02:56.590448 --- ParallelTerminationStrategy: PID 16177 died... 00:02:56.610198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16177): Terminated: ok {rc=0} 00:02:56.656069 --- ParallelTerminationStrategy: PID 16178 died... 00:02:56.675709 run iperf3-srv_10.42.42.10(pid=16178): Terminated {rc=256} 00:02:56.721496 --- ParallelTerminationStrategy: PID 16181 died... 00:02:56.741285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16181): Terminated: ok {rc=0} 00:02:56.787541 --- ParallelTerminationStrategy: PID 16184 died... 00:02:56.807230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16184): Terminated: ok {rc=0} 00:02:56.853278 --- ParallelTerminationStrategy: PID 16187 died... 00:02:56.872817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16187): Terminated: ok {rc=0} 00:02:56.959818 bus /gobi_0: Setting Powered False 00:02:58.057957 bus /gobi_0: Setting Powered False 00:02:59.173228 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 00:03:00.317529 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:00.329160 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:03:00.399308 tst iperf3.py: using LAC 37153 00:03:00.518833 tst iperf3.py: using RAC 178 00:03:00.637601 tst iperf3.py: using CellId 37153 00:03:00.756557 tst iperf3.py: using BVCI 37154 00:03:00.875942 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:00.888914 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:00.901607 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:00.925295 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:00.937535 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:00.949857 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:00.961671 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:00.974297 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:00.987252 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:01.107785 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:03:01.354639 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:03:01.715460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16190): Launched 00:03:01.997727 run iperf3-srv_10.42.42.10(pid=16191): Launched 00:03:02.116251 tst iperf3.py:8: start network... 00:03:02.320217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:02.784266 run create_hlr_db(pid=16192): Launched 00:03:02.906703 bus /gobi_6: Setting Powered False 00:03:03.966223 run create_hlr_db(pid=16192): Terminated: ok {rc=0} 00:03:04.402421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16194): Launched 00:03:04.721710 run osmo-hlr_10.42.42.2(pid=16195): Launched 00:03:04.844337 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:05.397313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16197): Launched 00:03:05.715670 run osmo-stp_10.42.42.5(pid=16198): Launched 00:03:05.837202 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:06.391616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16200): Launched 00:03:06.513085 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:06.782109 run patchelf(pid=16201): Launched 00:03:06.959573 run osmo-stp_10.42.42.5(pid=16198): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16198)] 00:03:07.094822 run osmo-stp_10.42.42.5(pid=16198): stdout: | (launched: 2022-12-14_00:03:05.657876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:07.231684 run osmo-stp_10.42.42.5(pid=16198): stderr: | [0;m[38;5;43m20221214000305852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000305852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000305852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000305852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000305853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000305853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000305853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:07.368814 run osmo-stp_10.42.42.5(pid=16198): stdout: | (launched: 2022-12-14_00:03:05.657876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:07.499535 run osmo-stp_10.42.42.5(pid=16198): stderr: | [0;m[38;5;43m20221214000305852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000305852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000305852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000305852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000305853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000305853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000305853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:07.655090 run patchelf(pid=16201): Terminating (SIGINT) 00:03:07.834265 run patchelf(pid=16201): Terminated: ok {rc=0} 00:03:07.962744 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16198): Process ended prematurely: osmo-stp_10.42.42.5(pid=16198) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16198)] [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 00:03:07.972542 tst iperf3.py:8: Test FAILED (7.7 sec) 00:03:08.000890 run osmo-hlr_10.42.42.2(pid=16195): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16195)] 00:03:08.051251 run osmo-hlr_10.42.42.2(pid=16195): stdout: | (launched: 2022-12-14_00:03:04.663577) 00:03:08.102987 run osmo-hlr_10.42.42.2(pid=16195): stderr: | [0;m[1;31m20221214000304862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000304862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000304862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000304862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000304862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000304862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000304874 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000304884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000304885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000304885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:08.155219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16190): Terminating (SIGTERM) 00:03:08.197163 run iperf3-srv_10.42.42.10(pid=16191): Terminating (SIGTERM) 00:03:08.238990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16194): Terminating (SIGTERM) 00:03:08.280705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16197): Terminating (SIGTERM) 00:03:08.322631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16200): Terminating (SIGTERM) 00:03:08.365105 --- ParallelTerminationStrategy: PID 16190 died... 00:03:08.385492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16190): Terminated: ok {rc=0} 00:03:08.432119 --- ParallelTerminationStrategy: PID 16191 died... 00:03:08.452014 run iperf3-srv_10.42.42.10(pid=16191): Terminated {rc=256} 00:03:08.498248 --- ParallelTerminationStrategy: PID 16194 died... 00:03:08.518216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16194): Terminated: ok {rc=0} 00:03:08.564529 --- ParallelTerminationStrategy: PID 16197 died... 00:03:08.584450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16197): Terminated: ok {rc=0} 00:03:08.630579 --- ParallelTerminationStrategy: PID 16200 died... 00:03:08.650523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16200): Terminated: ok {rc=0} 00:03:08.736562 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 00:03:09.884505 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:09.896141 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:03:09.965081 tst iperf3m4.py: using LAC 37154 00:03:10.081478 tst iperf3m4.py: using RAC 179 00:03:10.199850 tst iperf3m4.py: using CellId 37154 00:03:10.324467 tst iperf3m4.py: using BVCI 37155 00:03:10.439816 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:10.451403 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:10.462761 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:10.474087 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:10.485637 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:10.496864 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:10.508382 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:10.519809 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:10.531329 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:10.649644 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:10.771134 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:10.888714 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:11.009964 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:03:11.226514 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:03:11.546970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16202): Launched 00:03:11.825986 run iperf3-srv_10.42.42.10(pid=16203): Launched 00:03:11.946362 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:03:12.162145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:03:12.482850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16204): Launched 00:03:12.760618 run iperf3-srv_10.42.42.10(pid=16205): Launched 00:03:12.881121 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:03:13.096556 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:03:13.417706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16206): Launched 00:03:13.694894 run iperf3-srv_10.42.42.10(pid=16207): Launched 00:03:13.815062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:03:14.030829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:03:14.350912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16208): Launched 00:03:14.628350 run iperf3-srv_10.42.42.10(pid=16209): Launched 00:03:14.748561 tst iperf3m4.py:8: start network... 00:03:14.965014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:15.460240 run create_hlr_db(pid=16210): Launched 00:03:15.581236 bus /gobi_6: Setting Powered False 00:03:16.642597 run create_hlr_db(pid=16210): Terminated: ok {rc=0} 00:03:17.100028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16212): Launched 00:03:17.426701 run osmo-hlr_10.42.42.2(pid=16213): Launched 00:03:17.549347 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:18.100275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16215): Launched 00:03:18.419702 run osmo-stp_10.42.42.5(pid=16216): Launched 00:03:18.542203 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:19.097754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16218): Launched 00:03:19.219562 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:19.488919 run patchelf(pid=16219): Launched 00:03:19.666199 run osmo-stp_10.42.42.5(pid=16216): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16216)] 00:03:19.801761 run osmo-stp_10.42.42.5(pid=16216): stdout: | (launched: 2022-12-14_00:03:18.361327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:19.938742 run osmo-stp_10.42.42.5(pid=16216): stderr: | [0;m[38;5;43m20221214000318555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000318555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000318555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000318555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000318556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000318556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000318556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:20.075631 run osmo-stp_10.42.42.5(pid=16216): stdout: | (launched: 2022-12-14_00:03:18.361327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:20.206845 run osmo-stp_10.42.42.5(pid=16216): stderr: | [0;m[38;5;43m20221214000318555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000318555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000318555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000318555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000318556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000318556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000318556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:20.361629 run patchelf(pid=16219): Terminating (SIGINT) 00:03:20.541224 run patchelf(pid=16219): Terminated: ok {rc=0} 00:03:20.670358 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16216): Process ended prematurely: osmo-stp_10.42.42.5(pid=16216) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16216)] [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 00:03:20.680337 tst iperf3m4.py:8: Test FAILED (10.8 sec) 00:03:20.709156 run osmo-hlr_10.42.42.2(pid=16213): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16213)] 00:03:20.760335 run osmo-hlr_10.42.42.2(pid=16213): stdout: | (launched: 2022-12-14_00:03:17.368348) 00:03:20.812764 run osmo-hlr_10.42.42.2(pid=16213): stderr: | [0;m[1;31m20221214000317566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000317566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000317566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000317566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000317566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000317566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000317579 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000317587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000317587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000317587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:20.865670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16202): Terminating (SIGTERM) 00:03:20.907785 run iperf3-srv_10.42.42.10(pid=16203): Terminating (SIGTERM) 00:03:20.949830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16204): Terminating (SIGTERM) 00:03:20.992578 run iperf3-srv_10.42.42.10(pid=16205): Terminating (SIGTERM) 00:03:21.035201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16206): Terminating (SIGTERM) 00:03:21.077618 run iperf3-srv_10.42.42.10(pid=16207): Terminating (SIGTERM) 00:03:21.119604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16208): Terminating (SIGTERM) 00:03:21.162011 run iperf3-srv_10.42.42.10(pid=16209): Terminating (SIGTERM) 00:03:21.204889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16212): Terminating (SIGTERM) 00:03:21.247535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16215): Terminating (SIGTERM) 00:03:21.290048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16218): Terminating (SIGTERM) 00:03:21.332264 --- ParallelTerminationStrategy: PID 16202 died... 00:03:21.352501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16202): Terminated: ok {rc=0} 00:03:21.399488 --- ParallelTerminationStrategy: PID 16203 died... 00:03:21.419364 run iperf3-srv_10.42.42.10(pid=16203): Terminated {rc=256} 00:03:21.466011 --- ParallelTerminationStrategy: PID 16204 died... 00:03:21.486060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16204): Terminated: ok {rc=0} 00:03:21.532246 --- ParallelTerminationStrategy: PID 16205 died... 00:03:21.552163 run iperf3-srv_10.42.42.10(pid=16205): Terminated {rc=256} 00:03:21.598326 --- ParallelTerminationStrategy: PID 16206 died... 00:03:21.618206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16206): Terminated: ok {rc=0} 00:03:21.664385 --- ParallelTerminationStrategy: PID 16207 died... 00:03:21.684270 run iperf3-srv_10.42.42.10(pid=16207): Terminated {rc=256} 00:03:21.730541 --- ParallelTerminationStrategy: PID 16208 died... 00:03:21.750413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16208): Terminated: ok {rc=0} 00:03:21.796841 --- ParallelTerminationStrategy: PID 16209 died... 00:03:21.817096 run iperf3-srv_10.42.42.10(pid=16209): Terminated {rc=256} 00:03:21.863405 --- ParallelTerminationStrategy: PID 16212 died... 00:03:21.883374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16212): Terminated: ok {rc=0} 00:03:21.929709 --- ParallelTerminationStrategy: PID 16215 died... 00:03:21.949615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16215): Terminated: ok {rc=0} 00:03:21.996349 --- ParallelTerminationStrategy: PID 16218 died... 00:03:22.016522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16218): Terminated: ok {rc=0} 00:03:22.104543 bus /gobi_4: Setting Powered False 00:03:23.203517 bus /gobi_4: Setting Powered False 00:03:24.321701 bus /gobi_1: Setting Powered False 00:03:25.420143 bus /gobi_1: Setting Powered False 00:03:26.535004 bus /gobi_0: Setting Powered False 00:03:27.635392 bus /gobi_0: Setting Powered False 00:03:28.754143 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 00:03:29.857793 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:29.869176 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:03:29.939445 tst ping.py: using LAC 37155 00:03:30.056010 tst ping.py: using RAC 180 00:03:30.173006 tst ping.py: using CellId 37155 00:03:30.288228 tst ping.py: using BVCI 37156 00:03:30.394720 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:30.405659 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:30.416285 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:30.426936 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:30.437400 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:30.447934 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:30.458618 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:30.469255 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:30.582489 tst ping.py:19: start network... 00:03:30.779131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:31.296463 run create_hlr_db(pid=16221): Launched 00:03:31.456348 bus /gobi_6: Setting Powered False 00:03:32.519372 run create_hlr_db(pid=16221): Terminated: ok {rc=0} 00:03:32.960174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16223): Launched 00:03:33.273995 run osmo-hlr_10.42.42.2(pid=16224): Launched 00:03:33.394274 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:33.937499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16226): Launched 00:03:34.250724 run osmo-stp_10.42.42.5(pid=16227): Launched 00:03:34.370215 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:34.912788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16229): Launched 00:03:35.032412 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:35.297974 run patchelf(pid=16230): Launched 00:03:35.473185 run osmo-stp_10.42.42.5(pid=16227): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16227)] 00:03:35.606646 run osmo-stp_10.42.42.5(pid=16227): stdout: | (launched: 2022-12-14_00:03:34.193520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:35.741599 run osmo-stp_10.42.42.5(pid=16227): stderr: | [0;m[38;5;43m20221214000334385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000334385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000334385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000334386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000334386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000334386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000334386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:35.876803 run osmo-stp_10.42.42.5(pid=16227): stdout: | (launched: 2022-12-14_00:03:34.193520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:36.005822 run osmo-stp_10.42.42.5(pid=16227): stderr: | [0;m[38;5;43m20221214000334385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000334385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000334385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000334386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000334386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000334386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000334386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:36.158303 run patchelf(pid=16230): Terminating (SIGINT) 00:03:36.334928 run patchelf(pid=16230): Terminated: ok {rc=0} 00:03:36.461783 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16227): Process ended prematurely: osmo-stp_10.42.42.5(pid=16227) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16227)] [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 00:03:36.471115 tst ping.py:22: Test FAILED (6.6 sec) 00:03:36.498796 run osmo-hlr_10.42.42.2(pid=16224): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16224)] 00:03:36.548922 run osmo-hlr_10.42.42.2(pid=16224): stdout: | (launched: 2022-12-14_00:03:33.216642) 00:03:36.600475 run osmo-hlr_10.42.42.2(pid=16224): stderr: | [0;m[1;31m20221214000333414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000333414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000333414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000333414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000333414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000333414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000333427 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000333435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000333435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000333435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:36.652334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16223): Terminating (SIGTERM) 00:03:36.694072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16226): Terminating (SIGTERM) 00:03:36.735650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16229): Terminating (SIGTERM) 00:03:36.777451 --- ParallelTerminationStrategy: PID 16223 died... 00:03:36.797942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16223): Terminated: ok {rc=0} 00:03:36.844423 --- ParallelTerminationStrategy: PID 16226 died... 00:03:36.864632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16226): Terminated: ok {rc=0} 00:03:36.910652 --- ParallelTerminationStrategy: PID 16229 died... 00:03:36.930395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16229): Terminated: ok {rc=0} 00:03:37.017399 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 00:03:38.104617 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:38.116456 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:03:38.186511 tst ping_idle_ping.py: using LAC 37156 00:03:38.315670 tst ping_idle_ping.py: using RAC 181 00:03:38.438242 tst ping_idle_ping.py: using CellId 37156 00:03:38.559678 tst ping_idle_ping.py: using BVCI 37157 00:03:38.675674 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:38.687151 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:38.698563 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:38.709934 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:38.721666 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:38.733496 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:38.745509 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:38.757475 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:38.872852 tst ping_idle_ping.py:24: start network... 00:03:39.069528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:39.530555 run create_hlr_db(pid=16231): Launched 00:03:39.651795 bus /gobi_6: Setting Powered False 00:03:40.712045 run create_hlr_db(pid=16231): Terminated: ok {rc=0} 00:03:41.126849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16233): Launched 00:03:41.422172 run osmo-hlr_10.42.42.2(pid=16234): Launched 00:03:41.534820 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:42.056999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16236): Launched 00:03:42.372033 run osmo-stp_10.42.42.5(pid=16237): Launched 00:03:42.493058 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:43.037683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16239): Launched 00:03:43.157720 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:43.423267 run patchelf(pid=16240): Launched 00:03:43.597535 run osmo-stp_10.42.42.5(pid=16237): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16237)] 00:03:43.730208 run osmo-stp_10.42.42.5(pid=16237): stdout: | (launched: 2022-12-14_00:03:42.314600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:43.865111 run osmo-stp_10.42.42.5(pid=16237): stderr: | [0;m[38;5;43m20221214000342507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000342507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000342507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000342508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000342508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000342508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000342509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:43.999395 run osmo-stp_10.42.42.5(pid=16237): stdout: | (launched: 2022-12-14_00:03:42.314600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:44.127960 run osmo-stp_10.42.42.5(pid=16237): stderr: | [0;m[38;5;43m20221214000342507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000342507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000342507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000342508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000342508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000342508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000342509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:44.280195 run patchelf(pid=16240): Terminating (SIGINT) 00:03:44.455557 run patchelf(pid=16240): Terminated: ok {rc=0} 00:03:44.581919 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16237): Process ended prematurely: osmo-stp_10.42.42.5(pid=16237) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16237)] [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 00:03:44.591324 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 00:03:44.619525 run osmo-hlr_10.42.42.2(pid=16234): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16234)] 00:03:44.670451 run osmo-hlr_10.42.42.2(pid=16234): stdout: | (launched: 2022-12-14_00:03:41.366982) 00:03:44.723507 run osmo-hlr_10.42.42.2(pid=16234): stderr: | [0;m[1;31m20221214000341543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000341543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000341543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000341543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000341543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000341543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000341556 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000341565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000341565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000341565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:44.776052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16233): Terminating (SIGTERM) 00:03:44.818899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16236): Terminating (SIGTERM) 00:03:44.861782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16239): Terminating (SIGTERM) 00:03:44.904855 --- ParallelTerminationStrategy: PID 16233 died... 00:03:44.925660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16233): Terminated: ok {rc=0} 00:03:44.972531 --- ParallelTerminationStrategy: PID 16236 died... 00:03:44.992666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16236): Terminated: ok {rc=0} 00:03:45.039178 --- ParallelTerminationStrategy: PID 16239 died... 00:03:45.059340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16239): Terminated: ok {rc=0} 00:03:45.146949 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:03:46.476703 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:03:46.487554 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:03:46.533154 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:03:46.578185 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:03:46.637770 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:03:46.702484 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:03:46.752744 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:03:47.279371 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:03:47.286552 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:47.298333 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:03:47.368063 tst switch_tch_pdch.py: using LAC 37157 00:03:47.485159 tst switch_tch_pdch.py: using RAC 182 00:03:47.600666 tst switch_tch_pdch.py: using CellId 37157 00:03:47.716666 tst switch_tch_pdch.py: using BVCI 37158 00:03:47.823239 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:47.834538 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:47.845574 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:47.856523 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:47.867360 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:47.878191 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:47.889223 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:47.900059 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:03:48.019518 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:03:48.140561 tst switch_tch_pdch.py:51: start network... 00:03:48.337753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:48.791609 run create_hlr_db(pid=16244): Launched 00:03:48.911664 bus /gobi_6: Setting Powered False 00:03:49.970098 run create_hlr_db(pid=16244): Terminated: ok {rc=0} 00:03:50.399959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16246): Launched 00:03:50.698153 run osmo-hlr_10.42.42.2(pid=16247): Launched 00:03:50.809397 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:51.312492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16249): Launched 00:03:51.605647 run osmo-stp_10.42.42.5(pid=16250): Launched 00:03:51.717284 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:52.221059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16252): Launched 00:03:52.332625 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:52.579284 run patchelf(pid=16253): Launched 00:03:52.741495 run osmo-stp_10.42.42.5(pid=16250): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16250)] 00:03:52.865168 run osmo-stp_10.42.42.5(pid=16250): stdout: | (launched: 2022-12-14_00:03:51.551948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:52.990422 run osmo-stp_10.42.42.5(pid=16250): stderr: | [0;m[38;5;43m20221214000351721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000351721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000351721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000351722 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000351722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000351722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000351722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:53.114990 run osmo-stp_10.42.42.5(pid=16250): stdout: | (launched: 2022-12-14_00:03:51.551948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:53.234955 run osmo-stp_10.42.42.5(pid=16250): stderr: | [0;m[38;5;43m20221214000351721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000351721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000351721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000351722 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000351722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000351722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000351722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:53.376808 run patchelf(pid=16253): Terminating (SIGINT) 00:03:53.541318 run patchelf(pid=16253): Terminated: ok {rc=0} 00:03:53.659104 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16250): Process ended prematurely: osmo-stp_10.42.42.5(pid=16250) [trial-2396↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16250)] [trial-2396↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:03:53.667670 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 00:03:53.694147 run osmo-hlr_10.42.42.2(pid=16247): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16247)] 00:03:53.741232 run osmo-hlr_10.42.42.2(pid=16247): stdout: | (launched: 2022-12-14_00:03:50.644436) 00:03:53.789891 run osmo-hlr_10.42.42.2(pid=16247): stderr: | [0;m[1;31m20221214000350822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000350822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000350822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000350822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000350822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000350822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000350838 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000350847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000350848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000350848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:53.839198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16246): Terminating (SIGTERM) 00:03:53.878435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16249): Terminating (SIGTERM) 00:03:53.917902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16252): Terminating (SIGTERM) 00:03:53.957852 --- ParallelTerminationStrategy: PID 16246 died... 00:03:53.977106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16246): Terminated: ok {rc=0} 00:03:54.020797 --- ParallelTerminationStrategy: PID 16249 died... 00:03:54.039963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16249): Terminated: ok {rc=0} 00:03:54.083625 --- ParallelTerminationStrategy: PID 16252 died... 00:03:54.102180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16252): Terminated: ok {rc=0} 00:03:54.185098 bus /gobi_0: Setting Powered False 00:03:55.282346 bus /gobi_0: Setting Powered False 00:03:56.399075 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 00:03:57.655911 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:03:57.661546 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 00:03:57.693883 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 00:03:57.728361 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 00:03:57.780919 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 00:03:57.815023 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 00:03:57.850922 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 00:03:58.402545 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 00:03:58.408543 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:58.419942 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 00:03:58.489821 tst switch_tch_pdch.py: using LAC 37158 00:03:58.605001 tst switch_tch_pdch.py: using RAC 183 00:03:58.718574 tst switch_tch_pdch.py: using CellId 37158 00:03:58.831795 tst switch_tch_pdch.py: using BVCI 37159 00:03:58.937690 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:58.948570 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:58.959729 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:58.970530 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:58.981312 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:58.992157 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:59.003046 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:59.014110 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:03:59.132116 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:03:59.246473 tst switch_tch_pdch.py:51: start network... 00:03:59.443036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:59.872871 run create_hlr_db(pid=16257): Launched 00:03:59.993767 bus /gobi_6: Setting Powered False 00:04:01.053195 run create_hlr_db(pid=16257): Terminated: ok {rc=0} 00:04:01.451786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16260): Launched 00:04:01.768165 run osmo-hlr_10.42.42.2(pid=16261): Launched 00:04:01.980223 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:02.541982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16263): Launched 00:04:02.833720 run osmo-stp_10.42.42.5(pid=16264): Launched 00:04:02.950337 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:04:03.465711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16266): Launched 00:04:03.586962 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:04:03.852859 run patchelf(pid=16267): Launched 00:04:04.027494 run osmo-stp_10.42.42.5(pid=16264): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16264)] 00:04:04.160699 run osmo-stp_10.42.42.5(pid=16264): stdout: | (launched: 2022-12-14_00:04:02.779835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:04.295369 run osmo-stp_10.42.42.5(pid=16264): stderr: | [0;m[38;5;43m20221214000402949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000402949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000402950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000402950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000402952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000402952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000402952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:04.430564 run osmo-stp_10.42.42.5(pid=16264): stdout: | (launched: 2022-12-14_00:04:02.779835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:04.559689 run osmo-stp_10.42.42.5(pid=16264): stderr: | [0;m[38;5;43m20221214000402949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000402949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000402950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000402950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000402952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000402952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000402952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:04.712317 run patchelf(pid=16267): Terminating (SIGINT) 00:04:04.889382 run patchelf(pid=16267): Terminated: ok {rc=0} 00:04:05.016633 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16264): Process ended prematurely: osmo-stp_10.42.42.5(pid=16264) [trial-2396↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16264)] [trial-2396↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 00:04:05.026242 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 00:04:05.054243 run osmo-hlr_10.42.42.2(pid=16261): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16261)] 00:04:05.105152 run osmo-hlr_10.42.42.2(pid=16261): stdout: | (launched: 2022-12-14_00:04:01.707885) 00:04:05.157249 run osmo-hlr_10.42.42.2(pid=16261): stderr: | [0;m[1;31m20221214000402080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000402083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000402083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000402083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000402083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000402083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000402112 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000402128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000402137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000402137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:05.209759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16260): Terminating (SIGTERM) 00:04:05.251626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16263): Terminating (SIGTERM) 00:04:05.293669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16266): Terminating (SIGTERM) 00:04:05.335953 --- ParallelTerminationStrategy: PID 16260 died... 00:04:05.356310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16260): Terminated: ok {rc=0} 00:04:05.402721 --- ParallelTerminationStrategy: PID 16263 died... 00:04:05.422439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16263): Terminated: ok {rc=0} 00:04:05.468341 --- ParallelTerminationStrategy: PID 16266 died... 00:04:05.488364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16266): Terminated: ok {rc=0} 00:04:05.576327 bus /gobi_0: Setting Powered False 00:04:06.672351 bus /gobi_0: Setting Powered False 00:04:07.786280 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 00:04:09.033839 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:09.037959 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:04:09.066507 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 00:04:09.073177 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:04:09.124888 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:04:09.154904 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 00:04:09.162064 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:04:09.697727 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 00:04:09.703335 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 00:04:09.714682 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:04:09.762406 tst mo_mt_sms.py: using LAC 37159 00:04:09.877652 tst mo_mt_sms.py: using RAC 184 00:04:09.991658 tst mo_mt_sms.py: using CellId 37159 00:04:10.105633 tst mo_mt_sms.py: using BVCI 37160 00:04:10.211719 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:04:10.329665 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:04:10.447542 tst mo_mt_sms.py:9: start nitb and bts... 00:04:10.661853 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:04:11.301855 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16272): Launched 00:04:11.614727 run osmo-nitb_10.42.42.2(pid=16273): Launched 00:04:11.788702 run osmo-nitb_10.42.42.2(pid=16273): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16273)] 00:04:11.930925 run osmo-nitb_10.42.42.2(pid=16273): stdout: | (launched: 2022-12-14_00:04:11.557873) 00:04:12.073558 run osmo-nitb_10.42.42.2(pid=16273): stderr: | (launched: 2022-12-14_00:04:11.604364) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:04:12.216090 run osmo-nitb_10.42.42.2(pid=16273): stdout: | (launched: 2022-12-14_00:04:11.557873) 00:04:12.353253 run osmo-nitb_10.42.42.2(pid=16273): stderr: | (launched: 2022-12-14_00:04:11.604364) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16273): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16273) [trial-2396↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16273)] 00:04:12.733090 tst osmo-nitb_10.42.42.2(pid=16273): stdout: | (launched: 2022-12-14_00:04:11.557873) 00:04:12.859575 tst osmo-nitb_10.42.42.2(pid=16273): stderr: | (launched: 2022-12-14_00:04:11.604364) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:04:13.008460 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=16273): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16273) [trial-2396↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16273)] [trial-2396↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 00:04:13.017631 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 00:04:13.024645 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16272): Terminating (SIGTERM) 00:04:13.235288 --- ParallelTerminationStrategy: PID 16272 died... 00:04:13.256576 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16272): Terminated: ok {rc=0} 00:04:13.346192 bus /sierra_3: Setting Powered False 00:04:14.444497 bus /sierra_3: Setting Powered False 00:04:15.561535 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 00:04:16.782332 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:16.786547 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:04:16.817724 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:04:16.847214 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:04:16.899135 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:04:16.930006 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:04:16.957811 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:04:17.505622 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 00:04:17.513049 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:17.525238 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:04:17.569283 tst mo_mt_sms.py: using LAC 37160 00:04:17.683064 tst mo_mt_sms.py: using RAC 185 00:04:17.796624 tst mo_mt_sms.py: using CellId 37160 00:04:17.910374 tst mo_mt_sms.py: using BVCI 37161 00:04:18.015629 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:18.026559 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:18.037375 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:18.047744 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:18.058187 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:18.069053 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:04:18.188568 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:04:18.304032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:18.757693 run create_hlr_db(pid=16277): Launched 00:04:18.877723 bus /sierra_2: Setting Powered False 00:04:19.937165 run create_hlr_db(pid=16277): Terminated: ok {rc=0} 00:04:20.366096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16279): Launched 00:04:20.678942 run osmo-hlr_10.42.42.2(pid=16280): Launched 00:04:20.798267 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:21.339782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16282): Launched 00:04:21.652130 run osmo-stp_10.42.42.5(pid=16283): Launched 00:04:21.772169 run osmo-msc_10.42.42.6: Starting osmo-msc 00:04:22.343351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16285): Launched 00:04:22.657761 run osmo-msc_10.42.42.6(pid=16286): Launched 00:04:22.835299 run osmo-stp_10.42.42.5(pid=16283): ERR: Terminated: ERROR {rc=1} [trial-2396↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16283)] 00:04:22.969238 run osmo-stp_10.42.42.5(pid=16283): stdout: | (launched: 2022-12-14_00:04:21.595247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:23.103496 run osmo-stp_10.42.42.5(pid=16283): stderr: | [0;m[38;5;43m20221214000421789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000421789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000421790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000421790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000421790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000421790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000421791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:23.236488 run osmo-stp_10.42.42.5(pid=16283): stdout: | (launched: 2022-12-14_00:04:21.595247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:23.361470 run osmo-stp_10.42.42.5(pid=16283): stderr: | [0;m[38;5;43m20221214000421789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000421789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000421790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000421790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000421790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000421790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000421791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:23.510908 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=16283): Process ended prematurely: osmo-stp_10.42.42.5(pid=16283) [trial-2396↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16283)] [trial-2396↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 00:04:23.519692 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 00:04:23.547086 run osmo-hlr_10.42.42.2(pid=16280): ERR: Terminated: ERROR {rc=237} [trial-2396↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16280)] 00:04:23.597613 run osmo-hlr_10.42.42.2(pid=16280): stdout: | (launched: 2022-12-14_00:04:20.621689) 00:04:23.649556 run osmo-hlr_10.42.42.2(pid=16280): stderr: | [0;m[1;31m20221214000420821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000420821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000420821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000420821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000420821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000420822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000420834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000420842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000420842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000420843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:23.722122 run osmo-msc_10.42.42.6(pid=16286): ERR: Terminated: ERROR {rc=2} [trial-2396↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16286)] 00:04:23.772321 run osmo-msc_10.42.42.6(pid=16286): stdout: | (launched: 2022-12-14_00:04:22.600613) 00:04:23.824915 run osmo-msc_10.42.42.6(pid=16286): stderr: | [0;m[38;5;43m20221214000422920 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000422920 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffa4ff23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000422921 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000422921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000422921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000422921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000422923 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000422923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000422923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000422923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:04:23.877393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16279): Terminating (SIGTERM) 00:04:23.919229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16282): Terminating (SIGTERM) 00:04:23.961779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16285): Terminating (SIGTERM) 00:04:24.004560 --- ParallelTerminationStrategy: PID 16279 died... 00:04:24.024886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16279): Terminated: ok {rc=0} 00:04:24.071442 --- ParallelTerminationStrategy: PID 16282 died... 00:04:24.091381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16282): Terminated: ok {rc=0} 00:04:24.137645 --- ParallelTerminationStrategy: PID 16285 died... 00:04:24.157583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16285): Terminated: ok {rc=0} 00:04:24.245923 bus /sierra_3: Setting Powered False 00:04:25.344446 bus /sierra_3: Setting Powered False 00:04:26.459762 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 00:04:27.689809 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:27.693887 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:04:27.722965 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 00:04:27.730105 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 00:04:27.767127 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:04:27.797685 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 00:04:27.804778 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 00:04:28.321386 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2396 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 00:04:28.326476 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 00:04:28.337537 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:04:28.380722 tst assert_extension.py: using LAC 37161 00:04:28.496651 tst assert_extension.py: using RAC 186 00:04:28.612665 tst assert_extension.py: using CellId 37161 00:04:28.727346 tst assert_extension.py: using BVCI 37162 00:04:28.832904 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 00:04:28.950669 tst assert_extension.py:10: start nitb and bts... 00:04:29.163093 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:04:29.806284 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16291): Launched 00:04:30.120309 run osmo-nitb_10.42.42.2(pid=16292): Launched 00:04:30.294837 run osmo-nitb_10.42.42.2(pid=16292): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16292)] 00:04:30.436317 run osmo-nitb_10.42.42.2(pid=16292): stdout: | (launched: 2022-12-14_00:04:30.063103) 00:04:30.579405 run osmo-nitb_10.42.42.2(pid=16292): stderr: | (launched: 2022-12-14_00:04:30.109894) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:04:30.722432 run osmo-nitb_10.42.42.2(pid=16292): stdout: | (launched: 2022-12-14_00:04:30.063103) 00:04:30.866359 run osmo-nitb_10.42.42.2(pid=16292): stderr: | (launched: 2022-12-14_00:04:30.109894) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16292): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16292) [trial-2396↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16292)] 00:04:31.238744 tst osmo-nitb_10.42.42.2(pid=16292): stdout: | (launched: 2022-12-14_00:04:30.063103) 00:04:31.368013 tst osmo-nitb_10.42.42.2(pid=16292): stderr: | (launched: 2022-12-14_00:04:30.109894) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:04:31.520256 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=16292): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16292) [trial-2396↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16292)] [trial-2396↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 00:04:31.529663 tst assert_extension.py:12: Test FAILED (3.2 sec) 00:04:31.537220 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16291): Terminating (SIGTERM) 00:04:31.749535 --- ParallelTerminationStrategy: PID 16291 died... 00:04:31.769905 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16291): Terminated: ok {rc=0} 00:04:31.886904 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 00:04:33.085019 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:33.089351 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:04:33.118919 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:04:33.147566 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 00:04:33.183606 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:04:33.213916 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:04:33.241815 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 00:04:33.772079 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2396 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 00:04:33.777538 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:33.788817 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:04:33.834293 tst assert_extension.py: using LAC 37162 00:04:33.958975 tst assert_extension.py: using RAC 187 00:04:34.080713 tst assert_extension.py: using CellId 37162 00:04:34.207330 tst assert_extension.py: using BVCI 37163 00:04:34.322421 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:34.333876 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:34.345187 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:34.356343 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:34.368020 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:34.379641 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 00:04:34.498614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:34.982407 run create_hlr_db(pid=16296): Launched 00:04:35.101328 bus /sierra_2: Setting Powered False 00:04:36.163734 run create_hlr_db(pid=16296): Terminated: ok {rc=0} 00:04:36.583360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16298): Launched 00:04:36.875593 run osmo-hlr_10.42.42.2(pid=16299): Launched 00:04:36.986548 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:37.508535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16301): Launched 00:04:37.802995 run osmo-stp_10.42.42.5(pid=16302): Launched 00:04:37.916772 run osmo-msc_10.42.42.6: Starting osmo-msc 00:04:38.446326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16304): Launched 00:04:38.738766 run osmo-msc_10.42.42.6(pid=16305): Launched 00:04:38.902287 run osmo-stp_10.42.42.5(pid=16302): ERR: Terminated: ERROR {rc=1} [trial-2396↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16302)] 00:04:39.025692 run osmo-stp_10.42.42.5(pid=16302): stdout: | (launched: 2022-12-14_00:04:37.748051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:39.149887 run osmo-stp_10.42.42.5(pid=16302): stderr: | [0;m[38;5;43m20221214000437918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000437918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000437918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000437919 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000437919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000437919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000437919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:39.271708 run osmo-stp_10.42.42.5(pid=16302): stdout: | (launched: 2022-12-14_00:04:37.748051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:39.387536 run osmo-stp_10.42.42.5(pid=16302): stderr: | [0;m[38;5;43m20221214000437918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000437918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000437918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000437919 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000437919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000437919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000437919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:39.526410 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=16302): Process ended prematurely: osmo-stp_10.42.42.5(pid=16302) [trial-2396↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16302)] [trial-2396↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 00:04:39.534764 tst assert_extension.py:17: Test FAILED (5.8 sec) 00:04:39.560636 run osmo-hlr_10.42.42.2(pid=16299): ERR: Terminated: ERROR {rc=237} [trial-2396↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16299)] 00:04:39.607905 run osmo-hlr_10.42.42.2(pid=16299): stdout: | (launched: 2022-12-14_00:04:36.821843) 00:04:39.656677 run osmo-hlr_10.42.42.2(pid=16299): stderr: | [0;m[1;31m20221214000436996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000436996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000436996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000436996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000436996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000436996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000437009 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000437018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000437018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000437019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:39.724871 run osmo-msc_10.42.42.6(pid=16305): ERR: Terminated: ERROR {rc=2} [trial-2396↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16305)] 00:04:39.771719 run osmo-msc_10.42.42.6(pid=16305): stdout: | (launched: 2022-12-14_00:04:38.685068) 00:04:39.820462 run osmo-msc_10.42.42.6(pid=16305): stderr: | [0;m[38;5;43m20221214000438955 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000438955 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f637d04cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000438955 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000438955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000438955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000438956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000438957 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000438958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000438958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000438958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:04:39.870094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16298): Terminating (SIGTERM) 00:04:39.909359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16301): Terminating (SIGTERM) 00:04:39.948560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16304): Terminating (SIGTERM) 00:04:39.987960 --- ParallelTerminationStrategy: PID 16298 died... 00:04:40.007121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16298): Terminated: ok {rc=0} 00:04:40.050801 --- ParallelTerminationStrategy: PID 16301 died... 00:04:40.069260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16301): Terminated: ok {rc=0} 00:04:40.112878 --- ParallelTerminationStrategy: PID 16304 died... 00:04:40.131936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16304): Terminated: ok {rc=0} 00:04:40.216775 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:04:41.422838 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:41.431341 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:04:41.461496 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:04:41.490219 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:04:41.543758 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:04:41.573980 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:04:41.601773 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:04:42.153802 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:04:42.206520 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:42.218501 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:04:42.286156 tst mo_mt_call.py: using LAC 37163 00:04:42.404941 tst mo_mt_call.py: using RAC 188 00:04:42.521704 tst mo_mt_call.py: using CellId 37163 00:04:42.639660 tst mo_mt_call.py: using BVCI 37164 00:04:42.747528 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:42.758736 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:42.769887 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:42.780837 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:42.791940 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:42.802977 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:04:42.921879 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:04:43.041295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:43.535303 run create_hlr_db(pid=16310): Launched 00:04:43.657655 bus /sierra_2: Setting Powered False 00:04:44.721119 run create_hlr_db(pid=16310): Terminated: ok {rc=0} 00:04:45.147918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16312): Launched 00:04:45.446075 run osmo-hlr_10.42.42.2(pid=16313): Launched 00:04:45.559550 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:46.105847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16315): Launched 00:04:46.435307 run osmo-stp_10.42.42.5(pid=16316): Launched 00:04:46.666711 run osmo-msc_10.42.42.6: Starting osmo-msc 00:04:47.378652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16318): Launched 00:04:47.676422 run osmo-msc_10.42.42.6(pid=16319): Launched 00:04:47.843527 run osmo-stp_10.42.42.5(pid=16316): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16316)] 00:04:47.971376 run osmo-stp_10.42.42.5(pid=16316): stdout: | (launched: 2022-12-14_00:04:46.365315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:48.097644 run osmo-stp_10.42.42.5(pid=16316): stderr: | [0;m[38;5;43m20221214000446694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000446694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000446695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000446695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000446695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000446696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000446696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:48.221548 run osmo-stp_10.42.42.5(pid=16316): stdout: | (launched: 2022-12-14_00:04:46.365315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:48.339853 run osmo-stp_10.42.42.5(pid=16316): stderr: | [0;m[38;5;43m20221214000446694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000446694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000446695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000446695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000446695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000446696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000446696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:48.481377 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16316): Process ended prematurely: osmo-stp_10.42.42.5(pid=16316) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16316)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:04:48.489991 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 00:04:48.516087 run osmo-hlr_10.42.42.2(pid=16313): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16313)] 00:04:48.563858 run osmo-hlr_10.42.42.2(pid=16313): stdout: | (launched: 2022-12-14_00:04:45.391357) 00:04:48.612749 run osmo-hlr_10.42.42.2(pid=16313): stderr: | [0;m[1;31m20221214000445568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000445568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000445568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000445568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000445569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000445569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000445580 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000445591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000445591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000445591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:48.681136 run osmo-msc_10.42.42.6(pid=16319): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16319)] 00:04:48.728212 run osmo-msc_10.42.42.6(pid=16319): stdout: | (launched: 2022-12-14_00:04:47.621277) 00:04:48.777072 run osmo-msc_10.42.42.6(pid=16319): stderr: | [0;m[38;5;43m20221214000447894 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000447894 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f32f6147c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000447894 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000447894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000447894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000447895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000447896 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000447897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000447897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000447897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:04:48.825950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16312): Terminating (SIGTERM) 00:04:48.864857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16315): Terminating (SIGTERM) 00:04:48.903577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16318): Terminating (SIGTERM) 00:04:48.942756 --- ParallelTerminationStrategy: PID 16312 died... 00:04:48.961552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16312): Terminated: ok {rc=0} 00:04:49.004603 --- ParallelTerminationStrategy: PID 16315 died... 00:04:49.022861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16315): Terminated: ok {rc=0} 00:04:49.066077 --- ParallelTerminationStrategy: PID 16318 died... 00:04:49.084437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16318): Terminated: ok {rc=0} 00:04:49.168381 bus /sierra_3: Setting Powered False 00:04:50.267041 bus /sierra_3: Setting Powered False 00:04:51.381188 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:04:52.525196 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:52.537075 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:04:52.603432 tst mo_mt_call_osmux.py: using LAC 37164 00:04:52.723986 tst mo_mt_call_osmux.py: using RAC 189 00:04:52.841507 tst mo_mt_call_osmux.py: using CellId 37164 00:04:52.965483 tst mo_mt_call_osmux.py: using BVCI 37165 00:04:53.083558 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:53.095505 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:53.107214 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:53.118775 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:53.130934 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:53.142814 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:04:53.258797 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:04:53.379218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:53.873757 run create_hlr_db(pid=16322): Launched 00:04:53.995118 bus /sierra_2: Setting Powered False 00:04:55.058329 run create_hlr_db(pid=16322): Terminated: ok {rc=0} 00:04:55.485711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16324): Launched 00:04:55.784363 run osmo-hlr_10.42.42.2(pid=16325): Launched 00:04:55.898876 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:56.428671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16327): Launched 00:04:56.726355 run osmo-stp_10.42.42.5(pid=16328): Launched 00:04:56.839208 run osmo-msc_10.42.42.6: Starting osmo-msc 00:04:57.382583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16330): Launched 00:04:57.680185 run osmo-msc_10.42.42.6(pid=16331): Launched 00:04:57.847981 run osmo-stp_10.42.42.5(pid=16328): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16328)] 00:04:57.974242 run osmo-stp_10.42.42.5(pid=16328): stdout: | (launched: 2022-12-14_00:04:56.671802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:58.101339 run osmo-stp_10.42.42.5(pid=16328): stderr: | [0;m[38;5;43m20221214000456844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000456844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000456844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000456844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000456845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000456845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000456845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:58.225559 run osmo-stp_10.42.42.5(pid=16328): stdout: | (launched: 2022-12-14_00:04:56.671802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:58.344820 run osmo-stp_10.42.42.5(pid=16328): stderr: | [0;m[38;5;43m20221214000456844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000456844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000456844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000456844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000456845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000456845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000456845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:58.486973 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16328): Process ended prematurely: osmo-stp_10.42.42.5(pid=16328) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16328)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:04:58.495619 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:04:58.521920 run osmo-hlr_10.42.42.2(pid=16325): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16325)] 00:04:58.569410 run osmo-hlr_10.42.42.2(pid=16325): stdout: | (launched: 2022-12-14_00:04:55.729644) 00:04:58.618724 run osmo-hlr_10.42.42.2(pid=16325): stderr: | [0;m[1;31m20221214000455905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000455905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000455905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000455905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000455905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000455906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000455918 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000455927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000455927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000455927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:58.687315 run osmo-msc_10.42.42.6(pid=16331): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16331)] 00:04:58.734833 run osmo-msc_10.42.42.6(pid=16331): stdout: | (launched: 2022-12-14_00:04:57.625412) 00:04:58.783684 run osmo-msc_10.42.42.6(pid=16331): stderr: | [0;m[38;5;43m20221214000457899 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000457899 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1754e63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000457899 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000457899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000457900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000457900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000457902 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000457902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000457902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000457902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:04:58.833123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16324): Terminating (SIGTERM) 00:04:58.872705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16327): Terminating (SIGTERM) 00:04:58.911906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16330): Terminating (SIGTERM) 00:04:58.951458 --- ParallelTerminationStrategy: PID 16324 died... 00:04:58.970458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16324): Terminated: ok {rc=0} 00:04:59.013996 --- ParallelTerminationStrategy: PID 16327 died... 00:04:59.032405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16327): Terminated: ok {rc=0} 00:04:59.076055 --- ParallelTerminationStrategy: PID 16330 died... 00:04:59.094653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16330): Terminated: ok {rc=0} 00:04:59.179419 bus /sierra_3: Setting Powered False 00:05:00.276452 bus /sierra_3: Setting Powered False 00:05:01.391765 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:05:02.641596 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:05:02.648139 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:05:02.676712 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:05:02.702889 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:05:02.754978 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:05:02.784503 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:05:02.810835 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:05:03.361344 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:05:03.410069 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:03.421295 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:05:03.489700 tst mo_mt_call.py: using LAC 37165 00:05:03.605646 tst mo_mt_call.py: using RAC 190 00:05:03.721638 tst mo_mt_call.py: using CellId 37165 00:05:03.839170 tst mo_mt_call.py: using BVCI 37166 00:05:03.957292 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:03.969196 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:03.980796 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:03.992541 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:04.004818 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:04.017256 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:05:04.133965 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:05:04.254352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:04.718045 run create_hlr_db(pid=16346): Launched 00:05:04.839810 bus /sierra_2: Setting Powered False 00:05:05.903533 run create_hlr_db(pid=16346): Terminated: ok {rc=0} 00:05:06.348801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16348): Launched 00:05:06.668165 run osmo-hlr_10.42.42.2(pid=16349): Launched 00:05:06.790493 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:07.343884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16351): Launched 00:05:07.663834 run osmo-stp_10.42.42.5(pid=16352): Launched 00:05:07.786390 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:08.366518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16354): Launched 00:05:08.687118 run osmo-msc_10.42.42.6(pid=16355): Launched 00:05:08.865525 run osmo-stp_10.42.42.5(pid=16352): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16352)] 00:05:09.000734 run osmo-stp_10.42.42.5(pid=16352): stdout: | (launched: 2022-12-14_00:05:07.605597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:09.136620 run osmo-stp_10.42.42.5(pid=16352): stderr: | [0;m[38;5;43m20221214000507800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000507800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000507801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000507801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000507801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000507801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000507802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:09.271506 run osmo-stp_10.42.42.5(pid=16352): stdout: | (launched: 2022-12-14_00:05:07.605597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:09.399176 run osmo-stp_10.42.42.5(pid=16352): stderr: | [0;m[38;5;43m20221214000507800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000507800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000507801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000507801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000507801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000507801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000507802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:09.551877 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16352): Process ended prematurely: osmo-stp_10.42.42.5(pid=16352) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16352)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:05:09.561520 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:05:09.589273 run osmo-hlr_10.42.42.2(pid=16349): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16349)] 00:05:09.639914 run osmo-hlr_10.42.42.2(pid=16349): stdout: | (launched: 2022-12-14_00:05:06.610219) 00:05:09.691869 run osmo-hlr_10.42.42.2(pid=16349): stderr: | [0;m[1;31m20221214000506810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000506810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000506810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000506810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000506810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000506811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000506827 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000506836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000506837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000506837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:09.764313 run osmo-msc_10.42.42.6(pid=16355): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16355)] 00:05:09.813911 run osmo-msc_10.42.42.6(pid=16355): stdout: | (launched: 2022-12-14_00:05:08.628498) 00:05:09.866364 run osmo-msc_10.42.42.6(pid=16355): stderr: | [0;m[38;5;43m20221214000508952 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000508953 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcfaf94fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000508953 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000508953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000508953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000508953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000508955 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000508955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000508955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000508955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:09.918371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16348): Terminating (SIGTERM) 00:05:09.960252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16351): Terminating (SIGTERM) 00:05:10.002376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16354): Terminating (SIGTERM) 00:05:10.045041 --- ParallelTerminationStrategy: PID 16348 died... 00:05:10.065303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16348): Terminated: ok {rc=0} 00:05:10.111469 --- ParallelTerminationStrategy: PID 16351 died... 00:05:10.131003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16351): Terminated: ok {rc=0} 00:05:10.177268 --- ParallelTerminationStrategy: PID 16354 died... 00:05:10.196843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16354): Terminated: ok {rc=0} 00:05:10.283999 bus /sierra_3: Setting Powered False 00:05:11.380658 bus /sierra_3: Setting Powered False 00:05:12.497894 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:05:13.654511 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:13.667902 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:05:13.739548 tst mo_mt_call_osmux.py: using LAC 37166 00:05:13.863256 tst mo_mt_call_osmux.py: using RAC 191 00:05:13.987040 tst mo_mt_call_osmux.py: using CellId 37166 00:05:14.109699 tst mo_mt_call_osmux.py: using BVCI 37167 00:05:14.222271 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:14.234295 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:14.246217 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:14.258287 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:14.270784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:14.282679 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:05:14.401594 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:05:14.519752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:14.985051 run create_hlr_db(pid=16708): Launched 00:05:15.107674 bus /sierra_2: Setting Powered False 00:05:16.171953 run create_hlr_db(pid=16708): Terminated: ok {rc=0} 00:05:16.607010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16710): Launched 00:05:16.932624 run osmo-hlr_10.42.42.2(pid=16711): Launched 00:05:17.168417 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:17.719808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16713): Launched 00:05:18.018981 run osmo-stp_10.42.42.5(pid=16714): Launched 00:05:18.132097 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:18.673705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16716): Launched 00:05:18.972065 run osmo-msc_10.42.42.6(pid=16717): Launched 00:05:19.139586 run osmo-stp_10.42.42.5(pid=16714): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16714)] 00:05:19.266316 run osmo-stp_10.42.42.5(pid=16714): stdout: | (launched: 2022-12-14_00:05:17.963828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:19.392808 run osmo-stp_10.42.42.5(pid=16714): stderr: | [0;m[38;5;43m20221214000518135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000518135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000518135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000518136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000518136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000518136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000518136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:19.517625 run osmo-stp_10.42.42.5(pid=16714): stdout: | (launched: 2022-12-14_00:05:17.963828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:19.636566 run osmo-stp_10.42.42.5(pid=16714): stderr: | [0;m[38;5;43m20221214000518135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000518135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000518135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000518136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000518136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000518136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000518136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:19.779009 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16714): Process ended prematurely: osmo-stp_10.42.42.5(pid=16714) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16714)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:05:19.787889 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:05:19.814227 run osmo-hlr_10.42.42.2(pid=16711): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16711)] 00:05:19.861985 run osmo-hlr_10.42.42.2(pid=16711): stdout: | (launched: 2022-12-14_00:05:16.869648) 00:05:19.911023 run osmo-hlr_10.42.42.2(pid=16711): stderr: | [0;m[1;31m20221214000517188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000517188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000517188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000517188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000517188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000517188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000517213 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000517231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000517232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000517232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:19.979735 run osmo-msc_10.42.42.6(pid=16717): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16717)] 00:05:20.026901 run osmo-msc_10.42.42.6(pid=16717): stdout: | (launched: 2022-12-14_00:05:18.917447) 00:05:20.075407 run osmo-msc_10.42.42.6(pid=16717): stderr: | [0;m[38;5;43m20221214000519189 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000519189 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f383cbc7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000519189 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000519189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000519189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000519189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000519191 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000519191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000519192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000519192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:20.124614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16710): Terminating (SIGTERM) 00:05:20.163857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16713): Terminating (SIGTERM) 00:05:20.203784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16716): Terminating (SIGTERM) 00:05:20.243371 --- ParallelTerminationStrategy: PID 16710 died... 00:05:20.262559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16710): Terminated: ok {rc=0} 00:05:20.306097 --- ParallelTerminationStrategy: PID 16713 died... 00:05:20.324737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16713): Terminated: ok {rc=0} 00:05:20.368420 --- ParallelTerminationStrategy: PID 16716 died... 00:05:20.387404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16716): Terminated: ok {rc=0} 00:05:20.472138 bus /sierra_3: Setting Powered False 00:05:21.571962 bus /sierra_3: Setting Powered False 00:05:22.686084 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:05:23.944803 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:05:23.951833 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:05:23.982026 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:05:24.009528 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:05:24.059903 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:05:24.089631 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:05:24.117480 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:05:24.668549 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:05:24.719889 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:24.733613 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:05:24.799908 tst mo_mt_call.py: using LAC 37167 00:05:24.919089 tst mo_mt_call.py: using RAC 192 00:05:25.038854 tst mo_mt_call.py: using CellId 37167 00:05:25.158301 tst mo_mt_call.py: using BVCI 37168 00:05:25.271338 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:25.283523 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:25.295686 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:25.307654 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:25.319960 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:25.333393 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:05:25.450475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:05:25.568743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:26.048369 run create_hlr_db(pid=16897): Launched 00:05:26.196181 bus /sierra_2: Setting Powered False 00:05:27.255883 run create_hlr_db(pid=16897): Terminated: ok {rc=0} 00:05:27.693449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16899): Launched 00:05:28.029660 run osmo-hlr_10.42.42.2(pid=16900): Launched 00:05:28.279290 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:28.944508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16903): Launched 00:05:29.267647 run osmo-stp_10.42.42.5(pid=16904): Launched 00:05:29.390791 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:29.979916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16906): Launched 00:05:30.307586 run osmo-msc_10.42.42.6(pid=16907): Launched 00:05:30.490533 run osmo-stp_10.42.42.5(pid=16904): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16904)] 00:05:30.627353 run osmo-stp_10.42.42.5(pid=16904): stdout: | (launched: 2022-12-14_00:05:29.208680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:30.764558 run osmo-stp_10.42.42.5(pid=16904): stderr: | [0;m[38;5;43m20221214000529401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000529402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000529402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000529402 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000529403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000529403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000529403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:30.917664 run osmo-stp_10.42.42.5(pid=16904): stdout: | (launched: 2022-12-14_00:05:29.208680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:31.053114 run osmo-stp_10.42.42.5(pid=16904): stderr: | [0;m[38;5;43m20221214000529401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000529402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000529402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000529402 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000529403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000529403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000529403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:31.203174 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16904): Process ended prematurely: osmo-stp_10.42.42.5(pid=16904) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16904)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:05:31.213181 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 00:05:31.240899 run osmo-hlr_10.42.42.2(pid=16900): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16900)] 00:05:31.301266 run osmo-hlr_10.42.42.2(pid=16900): stdout: | (launched: 2022-12-14_00:05:27.963876) 00:05:31.369303 run osmo-hlr_10.42.42.2(pid=16900): stderr: | [0;m[1;31m20221214000528263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000528263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000528263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000528263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000528263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000528263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000528290 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000528299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000528299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000528299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:31.463663 run osmo-msc_10.42.42.6(pid=16907): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16907)] 00:05:31.530743 run osmo-msc_10.42.42.6(pid=16907): stdout: | (launched: 2022-12-14_00:05:30.247845) 00:05:31.596447 run osmo-msc_10.42.42.6(pid=16907): stderr: | [0;m[38;5;43m20221214000530569 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000530569 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa38a828c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000530569 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000530569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000530570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000530570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000530571 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000530572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000530572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000530572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:31.665424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16899): Terminating (SIGTERM) 00:05:31.721942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16903): Terminating (SIGTERM) 00:05:31.772848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16906): Terminating (SIGTERM) 00:05:31.831083 --- ParallelTerminationStrategy: PID 16899 died... 00:05:31.857200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16899): Terminated: ok {rc=0} 00:05:31.920440 --- ParallelTerminationStrategy: PID 16903 died... 00:05:31.944036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16903): Terminated: ok {rc=0} 00:05:32.007187 --- ParallelTerminationStrategy: PID 16906 died... 00:05:32.033035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16906): Terminated: ok {rc=0} 00:05:32.146325 bus /sierra_3: Setting Powered False 00:05:33.259242 bus /sierra_3: Setting Powered False 00:05:34.375422 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:05:35.520885 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:35.533396 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:05:35.599909 tst mo_mt_call_osmux.py: using LAC 37168 00:05:35.722778 tst mo_mt_call_osmux.py: using RAC 193 00:05:35.841555 tst mo_mt_call_osmux.py: using CellId 37168 00:05:35.968165 tst mo_mt_call_osmux.py: using BVCI 37169 00:05:36.085767 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:36.097857 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:36.109518 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:36.121367 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:36.133470 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:36.145685 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:05:36.265604 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:05:36.384603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:36.852283 run create_hlr_db(pid=16909): Launched 00:05:36.975832 bus /sierra_2: Setting Powered False 00:05:38.035693 run create_hlr_db(pid=16909): Terminated: ok {rc=0} 00:05:38.457765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16911): Launched 00:05:38.758844 run osmo-hlr_10.42.42.2(pid=16912): Launched 00:05:38.873852 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:39.393215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16914): Launched 00:05:39.694978 run osmo-stp_10.42.42.5(pid=16915): Launched 00:05:39.811707 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:40.359444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16917): Launched 00:05:40.662353 run osmo-msc_10.42.42.6(pid=16918): Launched 00:05:40.834029 run osmo-stp_10.42.42.5(pid=16915): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16915)] 00:05:40.962776 run osmo-stp_10.42.42.5(pid=16915): stdout: | (launched: 2022-12-14_00:05:39.639091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:41.091228 run osmo-stp_10.42.42.5(pid=16915): stderr: | [0;m[38;5;43m20221214000539809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000539809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000539809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000539810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000539812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000539812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000539812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:41.216899 run osmo-stp_10.42.42.5(pid=16915): stdout: | (launched: 2022-12-14_00:05:39.639091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:41.338220 run osmo-stp_10.42.42.5(pid=16915): stderr: | [0;m[38;5;43m20221214000539809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000539809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000539809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000539810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000539812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000539812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000539812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:41.482588 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16915): Process ended prematurely: osmo-stp_10.42.42.5(pid=16915) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16915)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:05:41.491661 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:05:41.518074 run osmo-hlr_10.42.42.2(pid=16912): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16912)] 00:05:41.565342 run osmo-hlr_10.42.42.2(pid=16912): stdout: | (launched: 2022-12-14_00:05:38.703532) 00:05:41.614184 run osmo-hlr_10.42.42.2(pid=16912): stderr: | [0;m[1;31m20221214000538879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000538879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000538879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000538879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000538879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000538879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000538891 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000538900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000538900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000538900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:41.682404 run osmo-msc_10.42.42.6(pid=16918): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16918)] 00:05:41.729685 run osmo-msc_10.42.42.6(pid=16918): stdout: | (launched: 2022-12-14_00:05:40.606517) 00:05:41.778445 run osmo-msc_10.42.42.6(pid=16918): stderr: | [0;m[38;5;43m20221214000540879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000540879 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0bf5bffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000540879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000540880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000540880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000540880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000540882 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000540882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000540882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000540882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:41.827550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16911): Terminating (SIGTERM) 00:05:41.866458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16914): Terminating (SIGTERM) 00:05:41.905803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16917): Terminating (SIGTERM) 00:05:41.945773 --- ParallelTerminationStrategy: PID 16911 died... 00:05:41.964471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16911): Terminated: ok {rc=0} 00:05:42.008240 --- ParallelTerminationStrategy: PID 16914 died... 00:05:42.026754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16914): Terminated: ok {rc=0} 00:05:42.070595 --- ParallelTerminationStrategy: PID 16917 died... 00:05:42.089355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16917): Terminated: ok {rc=0} 00:05:42.173830 bus /sierra_3: Setting Powered False 00:05:43.272331 bus /sierra_3: Setting Powered False 00:05:44.384900 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 00:05:45.643331 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:05:45.651329 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 00:05:45.681180 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 00:05:45.709479 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 00:05:45.768392 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 00:05:45.799881 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 00:05:45.828805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 00:05:46.401959 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 00:05:46.452679 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:46.464670 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:05:46.532043 tst mo_mt_call.py: using LAC 37169 00:05:46.700525 tst mo_mt_call.py: using RAC 194 00:05:46.866848 tst mo_mt_call.py: using CellId 37169 00:05:46.990066 tst mo_mt_call.py: using BVCI 37170 00:05:47.141207 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:47.156235 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:47.169690 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:47.185027 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:47.198874 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:47.212525 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:05:47.336387 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:05:47.455592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:47.926269 run create_hlr_db(pid=16923): Launched 00:05:48.052482 bus /sierra_2: Setting Powered False 00:05:49.113524 run create_hlr_db(pid=16923): Terminated: ok {rc=0} 00:05:49.538112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16925): Launched 00:05:49.843001 run osmo-hlr_10.42.42.2(pid=16926): Launched 00:05:49.958462 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:50.495742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16928): Launched 00:05:50.797563 run osmo-stp_10.42.42.5(pid=16929): Launched 00:05:50.913077 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:51.463658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16931): Launched 00:05:51.766231 run osmo-msc_10.42.42.6(pid=16932): Launched 00:05:51.940037 run osmo-stp_10.42.42.5(pid=16929): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16929)] 00:05:52.067660 run osmo-stp_10.42.42.5(pid=16929): stdout: | (launched: 2022-12-14_00:05:50.741941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:52.195547 run osmo-stp_10.42.42.5(pid=16929): stderr: | [0;m[38;5;43m20221214000550912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000550912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000550912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000550913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000550915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000550915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000550915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:52.321176 run osmo-stp_10.42.42.5(pid=16929): stdout: | (launched: 2022-12-14_00:05:50.741941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:52.441861 run osmo-stp_10.42.42.5(pid=16929): stderr: | [0;m[38;5;43m20221214000550912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000550912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000550912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000550913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000550915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000550915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000550915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:52.586352 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16929): Process ended prematurely: osmo-stp_10.42.42.5(pid=16929) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16929)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 00:05:52.595287 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:05:52.621635 run osmo-hlr_10.42.42.2(pid=16926): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16926)] 00:05:52.669126 run osmo-hlr_10.42.42.2(pid=16926): stdout: | (launched: 2022-12-14_00:05:49.787255) 00:05:52.717991 run osmo-hlr_10.42.42.2(pid=16926): stderr: | [0;m[1;31m20221214000549968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000549968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000549968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000549968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000549968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000549968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000549980 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000549991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000549991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000549991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:52.786697 run osmo-msc_10.42.42.6(pid=16932): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16932)] 00:05:52.833857 run osmo-msc_10.42.42.6(pid=16932): stdout: | (launched: 2022-12-14_00:05:51.710349) 00:05:52.882614 run osmo-msc_10.42.42.6(pid=16932): stderr: | [0;m[38;5;43m20221214000551992 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000551992 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fefe1fcac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000551993 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000551993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000551993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000551993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000551995 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000551995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000551995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000551995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:52.931854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16925): Terminating (SIGTERM) 00:05:52.970814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16928): Terminating (SIGTERM) 00:05:53.009756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16931): Terminating (SIGTERM) 00:05:53.049353 --- ParallelTerminationStrategy: PID 16925 died... 00:05:53.068615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16925): Terminated: ok {rc=0} 00:05:53.112486 --- ParallelTerminationStrategy: PID 16928 died... 00:05:53.130877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16928): Terminated: ok {rc=0} 00:05:53.174821 --- ParallelTerminationStrategy: PID 16931 died... 00:05:53.193361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16931): Terminated: ok {rc=0} 00:05:53.277801 bus /sierra_3: Setting Powered False 00:05:54.377118 bus /sierra_3: Setting Powered False 00:05:55.493024 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 00:05:56.642054 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:56.654558 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:05:56.725441 tst mo_mt_call_osmux.py: using LAC 37170 00:05:56.844803 tst mo_mt_call_osmux.py: using RAC 195 00:05:56.962804 tst mo_mt_call_osmux.py: using CellId 37170 00:05:57.082144 tst mo_mt_call_osmux.py: using BVCI 37171 00:05:57.193493 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:57.204863 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:57.216166 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:57.227273 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:57.238646 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:57.249779 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:05:57.369830 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:05:57.487678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:57.960574 run create_hlr_db(pid=16934): Launched 00:05:58.084151 bus /sierra_2: Setting Powered False 00:05:59.145423 run create_hlr_db(pid=16934): Terminated: ok {rc=0} 00:05:59.587413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16936): Launched 00:05:59.913417 run osmo-hlr_10.42.42.2(pid=16937): Launched 00:06:00.039091 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:00.600211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16939): Launched 00:06:00.945307 run osmo-stp_10.42.42.5(pid=16940): Launched 00:06:01.254694 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:02.046313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16942): Launched 00:06:02.371897 run osmo-msc_10.42.42.6(pid=16943): Launched 00:06:02.609188 run osmo-stp_10.42.42.5(pid=16940): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16940)] 00:06:02.738398 run osmo-stp_10.42.42.5(pid=16940): stdout: | (launched: 2022-12-14_00:06:00.873495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:02.884844 run osmo-stp_10.42.42.5(pid=16940): stderr: | [0;m[38;5;43m20221214000601129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000601129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000601130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000601131 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000601132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000601134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000601134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:03.022936 run osmo-stp_10.42.42.5(pid=16940): stdout: | (launched: 2022-12-14_00:06:00.873495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:03.143871 run osmo-stp_10.42.42.5(pid=16940): stderr: | [0;m[38;5;43m20221214000601129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000601129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000601130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000601131 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000601132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000601134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000601134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:03.288128 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16940): Process ended prematurely: osmo-stp_10.42.42.5(pid=16940) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16940)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 00:06:03.297128 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 00:06:03.324170 run osmo-hlr_10.42.42.2(pid=16937): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16937)] 00:06:03.372397 run osmo-hlr_10.42.42.2(pid=16937): stdout: | (launched: 2022-12-14_00:05:59.853697) 00:06:03.422163 run osmo-hlr_10.42.42.2(pid=16937): stderr: | [0;m[1;31m20221214000600056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000600056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000600056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000600056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000600056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000600056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000600069 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000600077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000600078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000600078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:03.491641 run osmo-msc_10.42.42.6(pid=16943): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16943)] 00:06:03.540241 run osmo-msc_10.42.42.6(pid=16943): stdout: | (launched: 2022-12-14_00:06:02.315586) 00:06:03.590168 run osmo-msc_10.42.42.6(pid=16943): stderr: | [0;m[38;5;43m20221214000602623 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000602623 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1ad4059c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000602623 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000602623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000602623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000602623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000602625 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000602626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000602626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000602626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:03.640231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16936): Terminating (SIGTERM) 00:06:03.680063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16939): Terminating (SIGTERM) 00:06:03.720089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16942): Terminating (SIGTERM) 00:06:03.760570 --- ParallelTerminationStrategy: PID 16936 died... 00:06:03.780211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16936): Terminated: ok {rc=0} 00:06:03.824505 --- ParallelTerminationStrategy: PID 16939 died... 00:06:03.843387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16939): Terminated: ok {rc=0} 00:06:03.887545 --- ParallelTerminationStrategy: PID 16942 died... 00:06:03.906536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16942): Terminated: ok {rc=0} 00:06:03.992292 bus /sierra_3: Setting Powered False 00:06:05.091495 bus /sierra_3: Setting Powered False 00:06:06.207123 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:06:07.456274 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:06:07.464214 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:06:07.494049 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:06:07.522483 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:06:07.577474 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:06:07.607436 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:06:07.635099 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:06:08.193827 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:06:08.246247 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:08.258194 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:06:08.324246 tst mo_mt_call.py: using LAC 37171 00:06:08.452067 tst mo_mt_call.py: using RAC 196 00:06:08.578611 tst mo_mt_call.py: using CellId 37171 00:06:08.703185 tst mo_mt_call.py: using BVCI 37172 00:06:08.820620 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:08.832573 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:08.844303 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:08.855977 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:08.868070 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:08.880428 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:06:08.996459 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:06:09.118491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:09.586081 run create_hlr_db(pid=16948): Launched 00:06:09.708808 bus /sierra_2: Setting Powered False 00:06:10.769938 run create_hlr_db(pid=16948): Terminated: ok {rc=0} 00:06:11.212266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16950): Launched 00:06:11.535828 run osmo-hlr_10.42.42.2(pid=16951): Launched 00:06:11.657209 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:12.178822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16953): Launched 00:06:12.480213 run osmo-stp_10.42.42.5(pid=16954): Launched 00:06:12.595570 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:13.142088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16956): Launched 00:06:13.444798 run osmo-msc_10.42.42.6(pid=16957): Launched 00:06:13.614245 run osmo-stp_10.42.42.5(pid=16954): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16954)] 00:06:13.741924 run osmo-stp_10.42.42.5(pid=16954): stdout: | (launched: 2022-12-14_00:06:12.424610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:13.869850 run osmo-stp_10.42.42.5(pid=16954): stderr: | [0;m[38;5;43m20221214000612595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000612596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000612596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000612596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000612597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000612597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000612597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:13.995764 run osmo-stp_10.42.42.5(pid=16954): stdout: | (launched: 2022-12-14_00:06:12.424610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:14.115908 run osmo-stp_10.42.42.5(pid=16954): stderr: | [0;m[38;5;43m20221214000612595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000612596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000612596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000612596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000612597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000612597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000612597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:14.259948 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16954): Process ended prematurely: osmo-stp_10.42.42.5(pid=16954) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16954)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:06:14.268797 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:06:14.294883 run osmo-hlr_10.42.42.2(pid=16951): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16951)] 00:06:14.342856 run osmo-hlr_10.42.42.2(pid=16951): stdout: | (launched: 2022-12-14_00:06:11.476904) 00:06:14.391646 run osmo-hlr_10.42.42.2(pid=16951): stderr: | [0;m[1;31m20221214000611656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000611657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000611657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000611657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000611657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000611657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000611704 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000611713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000611713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000611713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:14.460060 run osmo-msc_10.42.42.6(pid=16957): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16957)] 00:06:14.507157 run osmo-msc_10.42.42.6(pid=16957): stdout: | (launched: 2022-12-14_00:06:13.389040) 00:06:14.555906 run osmo-msc_10.42.42.6(pid=16957): stderr: | [0;m[38;5;43m20221214000613662 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000613663 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7eff5b399c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000613663 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000613663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000613663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000613663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000613665 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000613666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000613666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000613666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:14.605410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16950): Terminating (SIGTERM) 00:06:14.644856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16953): Terminating (SIGTERM) 00:06:14.683984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16956): Terminating (SIGTERM) 00:06:14.723439 --- ParallelTerminationStrategy: PID 16950 died... 00:06:14.742553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16950): Terminated: ok {rc=0} 00:06:14.785925 --- ParallelTerminationStrategy: PID 16953 died... 00:06:14.804381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16953): Terminated: ok {rc=0} 00:06:14.847675 --- ParallelTerminationStrategy: PID 16956 died... 00:06:14.866222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16956): Terminated: ok {rc=0} 00:06:14.948891 bus /sierra_3: Setting Powered False 00:06:16.043425 bus /sierra_3: Setting Powered False 00:06:17.159524 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:06:18.312478 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:18.324696 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:06:18.391534 tst mo_mt_call_osmux.py: using LAC 37172 00:06:18.510932 tst mo_mt_call_osmux.py: using RAC 197 00:06:18.631402 tst mo_mt_call_osmux.py: using CellId 37172 00:06:18.753071 tst mo_mt_call_osmux.py: using BVCI 37173 00:06:18.863777 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:18.875203 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:18.886422 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:18.897636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:18.908795 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:18.919930 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:06:19.035188 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:06:19.155934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:19.657710 run create_hlr_db(pid=16959): Launched 00:06:19.784561 bus /sierra_2: Setting Powered False 00:06:20.848613 run create_hlr_db(pid=16959): Terminated: ok {rc=0} 00:06:21.283094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16961): Launched 00:06:21.610072 run osmo-hlr_10.42.42.2(pid=16962): Launched 00:06:21.735755 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:22.294990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16964): Launched 00:06:22.618445 run osmo-stp_10.42.42.5(pid=16965): Launched 00:06:22.743923 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:23.331494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16967): Launched 00:06:23.656091 run osmo-msc_10.42.42.6(pid=16968): Launched 00:06:23.837209 run osmo-stp_10.42.42.5(pid=16965): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16965)] 00:06:23.974333 run osmo-stp_10.42.42.5(pid=16965): stdout: | (launched: 2022-12-14_00:06:22.559441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:24.111823 run osmo-stp_10.42.42.5(pid=16965): stderr: | [0;m[38;5;43m20221214000622751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000622752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000622752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000622752 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000622755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000622755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000622755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:24.248249 run osmo-stp_10.42.42.5(pid=16965): stdout: | (launched: 2022-12-14_00:06:22.559441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:24.377458 run osmo-stp_10.42.42.5(pid=16965): stderr: | [0;m[38;5;43m20221214000622751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000622752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000622752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000622752 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000622755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000622755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000622755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:24.531869 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16965): Process ended prematurely: osmo-stp_10.42.42.5(pid=16965) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16965)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:06:24.541539 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:06:24.569527 run osmo-hlr_10.42.42.2(pid=16962): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16962)] 00:06:24.620225 run osmo-hlr_10.42.42.2(pid=16962): stdout: | (launched: 2022-12-14_00:06:21.551117) 00:06:24.672635 run osmo-hlr_10.42.42.2(pid=16962): stderr: | [0;m[1;31m20221214000621748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000621748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000621748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000621748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000621749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000621749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000621760 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000621769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000621769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000621769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:24.745638 run osmo-msc_10.42.42.6(pid=16968): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16968)] 00:06:24.795447 run osmo-msc_10.42.42.6(pid=16968): stdout: | (launched: 2022-12-14_00:06:23.596821) 00:06:24.847622 run osmo-msc_10.42.42.6(pid=16968): stderr: | [0;m[38;5;43m20221214000623919 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000623919 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa8b7f93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000623919 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000623919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000623920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000623920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000623921 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000623922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000623922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000623922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:24.900161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16961): Terminating (SIGTERM) 00:06:24.942049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16964): Terminating (SIGTERM) 00:06:24.984066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16967): Terminating (SIGTERM) 00:06:25.026560 --- ParallelTerminationStrategy: PID 16961 died... 00:06:25.047030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16961): Terminated: ok {rc=0} 00:06:25.093664 --- ParallelTerminationStrategy: PID 16964 died... 00:06:25.113692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16964): Terminated: ok {rc=0} 00:06:25.159902 --- ParallelTerminationStrategy: PID 16967 died... 00:06:25.179884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16967): Terminated: ok {rc=0} 00:06:25.269278 bus /sierra_3: Setting Powered False 00:06:26.368698 bus /sierra_3: Setting Powered False 00:06:27.485838 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:06:28.734691 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:06:28.741142 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:06:28.769986 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:06:28.796698 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:06:28.849972 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:06:28.879670 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:06:28.906464 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:06:29.458176 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:06:29.506674 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:29.518286 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:06:29.586815 tst mo_mt_call.py: using LAC 37173 00:06:29.705635 tst mo_mt_call.py: using RAC 198 00:06:29.824680 tst mo_mt_call.py: using CellId 37173 00:06:29.941067 tst mo_mt_call.py: using BVCI 37174 00:06:30.050192 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:30.061697 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:30.072837 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:30.084155 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:30.095487 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:30.106761 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:06:30.222559 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:06:30.341991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:30.813079 run create_hlr_db(pid=16973): Launched 00:06:30.988319 bus /sierra_2: Setting Powered False 00:06:32.062238 run create_hlr_db(pid=16973): Terminated: ok {rc=0} 00:06:32.491450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16975): Launched 00:06:32.795458 run osmo-hlr_10.42.42.2(pid=16976): Launched 00:06:32.910558 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:33.447334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16978): Launched 00:06:33.749027 run osmo-stp_10.42.42.5(pid=16979): Launched 00:06:33.866314 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:34.413745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16981): Launched 00:06:34.717020 run osmo-msc_10.42.42.6(pid=16982): Launched 00:06:34.886869 run osmo-stp_10.42.42.5(pid=16979): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16979)] 00:06:35.015082 run osmo-stp_10.42.42.5(pid=16979): stdout: | (launched: 2022-12-14_00:06:33.693372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:35.142571 run osmo-stp_10.42.42.5(pid=16979): stderr: | [0;m[38;5;43m20221214000633864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000633864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000633864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000633865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000633865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000633865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000633865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:35.268298 run osmo-stp_10.42.42.5(pid=16979): stdout: | (launched: 2022-12-14_00:06:33.693372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:35.388536 run osmo-stp_10.42.42.5(pid=16979): stderr: | [0;m[38;5;43m20221214000633864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000633864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000633864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000633865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000633865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000633865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000633865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:35.532337 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16979): Process ended prematurely: osmo-stp_10.42.42.5(pid=16979) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16979)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:06:35.541248 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:06:35.567640 run osmo-hlr_10.42.42.2(pid=16976): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16976)] 00:06:35.614837 run osmo-hlr_10.42.42.2(pid=16976): stdout: | (launched: 2022-12-14_00:06:32.738351) 00:06:35.663617 run osmo-hlr_10.42.42.2(pid=16976): stderr: | [0;m[1;31m20221214000632918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000632918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000632918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000632918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000632918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000632918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000632930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000632942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000632942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000632942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:35.732007 run osmo-msc_10.42.42.6(pid=16982): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16982)] 00:06:35.779179 run osmo-msc_10.42.42.6(pid=16982): stdout: | (launched: 2022-12-14_00:06:34.661109) 00:06:35.827920 run osmo-msc_10.42.42.6(pid=16982): stderr: | [0;m[38;5;43m20221214000634934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000634934 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe7eabcdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000634935 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000634935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000634935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000634935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000634938 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000634938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000634938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000634938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:35.876803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16975): Terminating (SIGTERM) 00:06:35.916446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16978): Terminating (SIGTERM) 00:06:35.955583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16981): Terminating (SIGTERM) 00:06:35.995199 --- ParallelTerminationStrategy: PID 16975 died... 00:06:36.014239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16975): Terminated: ok {rc=0} 00:06:36.057880 --- ParallelTerminationStrategy: PID 16978 died... 00:06:36.076460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16978): Terminated: ok {rc=0} 00:06:36.120013 --- ParallelTerminationStrategy: PID 16981 died... 00:06:36.138678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16981): Terminated: ok {rc=0} 00:06:36.222780 bus /sierra_3: Setting Powered False 00:06:37.320489 bus /sierra_3: Setting Powered False 00:06:38.433381 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:06:39.578947 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:39.591043 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:06:39.657867 tst mo_mt_call_osmux.py: using LAC 37174 00:06:39.778261 tst mo_mt_call_osmux.py: using RAC 199 00:06:39.896745 tst mo_mt_call_osmux.py: using CellId 37174 00:06:40.015038 tst mo_mt_call_osmux.py: using BVCI 37175 00:06:40.126136 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:40.137597 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:40.149381 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:40.160488 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:40.171825 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:40.182993 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:06:40.305601 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:06:40.425698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:40.897282 run create_hlr_db(pid=16984): Launched 00:06:41.020611 bus /sierra_2: Setting Powered False 00:06:42.081628 run create_hlr_db(pid=16984): Terminated: ok {rc=0} 00:06:42.523669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16986): Launched 00:06:42.850165 run osmo-hlr_10.42.42.2(pid=16987): Launched 00:06:42.976431 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:43.535226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16989): Launched 00:06:43.860040 run osmo-stp_10.42.42.5(pid=16990): Launched 00:06:43.984513 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:44.570236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16992): Launched 00:06:44.895663 run osmo-msc_10.42.42.6(pid=16993): Launched 00:06:45.078718 run osmo-stp_10.42.42.5(pid=16990): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16990)] 00:06:45.215487 run osmo-stp_10.42.42.5(pid=16990): stdout: | (launched: 2022-12-14_00:06:43.801178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:45.353526 run osmo-stp_10.42.42.5(pid=16990): stderr: | [0;m[38;5;43m20221214000643995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000643995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000643996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000643996 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000643997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000643997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000643997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:45.490604 run osmo-stp_10.42.42.5(pid=16990): stdout: | (launched: 2022-12-14_00:06:43.801178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:45.620077 run osmo-stp_10.42.42.5(pid=16990): stderr: | [0;m[38;5;43m20221214000643995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000643995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000643996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000643996 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000643997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000643997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000643997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:45.774751 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16990): Process ended prematurely: osmo-stp_10.42.42.5(pid=16990) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16990)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:06:45.784418 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:06:45.812414 run osmo-hlr_10.42.42.2(pid=16987): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16987)] 00:06:45.879280 run osmo-hlr_10.42.42.2(pid=16987): stdout: | (launched: 2022-12-14_00:06:42.790730) 00:06:45.939754 run osmo-hlr_10.42.42.2(pid=16987): stderr: | [0;m[1;31m20221214000642992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000642992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000642992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000642992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000642992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000642992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000643005 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000643013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000643013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000643013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:46.011145 run osmo-msc_10.42.42.6(pid=16993): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16993)] 00:06:46.060096 run osmo-msc_10.42.42.6(pid=16993): stdout: | (launched: 2022-12-14_00:06:44.836178) 00:06:46.111178 run osmo-msc_10.42.42.6(pid=16993): stderr: | [0;m[38;5;43m20221214000645160 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000645160 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffb898ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000645160 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000645160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000645160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000645160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000645162 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000645163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000645163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000645163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:46.163561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16986): Terminating (SIGTERM) 00:06:46.205542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16989): Terminating (SIGTERM) 00:06:46.248628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16992): Terminating (SIGTERM) 00:06:46.292506 --- ParallelTerminationStrategy: PID 16986 died... 00:06:46.313325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16986): Terminated: ok {rc=0} 00:06:46.361747 --- ParallelTerminationStrategy: PID 16989 died... 00:06:46.381749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16989): Terminated: ok {rc=0} 00:06:46.427538 --- ParallelTerminationStrategy: PID 16992 died... 00:06:46.447549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16992): Terminated: ok {rc=0} 00:06:46.534159 bus /sierra_3: Setting Powered False 00:06:47.630248 bus /sierra_3: Setting Powered False 00:06:48.744577 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:06:49.995190 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:06:50.001169 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:06:50.029767 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 00:06:50.056375 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 00:06:50.107536 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:06:50.136688 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 00:06:50.164099 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 00:06:50.714610 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 00:06:50.764178 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:50.775318 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:06:50.842413 tst mo_mt_call.py: using LAC 37175 00:06:50.963519 tst mo_mt_call.py: using RAC 200 00:06:51.084022 tst mo_mt_call.py: using CellId 37175 00:06:51.202361 tst mo_mt_call.py: using BVCI 37176 00:06:51.314008 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:51.325233 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:51.336138 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:51.347058 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:51.358022 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:51.368934 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:06:51.485771 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:06:51.602974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:52.073474 run create_hlr_db(pid=16998): Launched 00:06:52.196626 bus /sierra_2: Setting Powered False 00:06:53.256535 run create_hlr_db(pid=16998): Terminated: ok {rc=0} 00:06:53.699978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17000): Launched 00:06:54.025140 run osmo-hlr_10.42.42.2(pid=17001): Launched 00:06:54.148594 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:54.709307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17003): Launched 00:06:55.034168 run osmo-stp_10.42.42.5(pid=17004): Launched 00:06:55.158685 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:55.744927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17006): Launched 00:06:56.070527 run osmo-msc_10.42.42.6(pid=17007): Launched 00:06:56.253430 run osmo-stp_10.42.42.5(pid=17004): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17004)] 00:06:56.390272 run osmo-stp_10.42.42.5(pid=17004): stdout: | (launched: 2022-12-14_00:06:54.974906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:56.527875 run osmo-stp_10.42.42.5(pid=17004): stderr: | [0;m[38;5;43m20221214000655169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000655169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000655169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000655170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000655170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000655170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000655170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:56.664876 run osmo-stp_10.42.42.5(pid=17004): stdout: | (launched: 2022-12-14_00:06:54.974906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:56.794440 run osmo-stp_10.42.42.5(pid=17004): stderr: | [0;m[38;5;43m20221214000655169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000655169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000655169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000655170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000655170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000655170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000655170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:56.950348 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17004): Process ended prematurely: osmo-stp_10.42.42.5(pid=17004) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17004)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 00:06:56.959990 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:06:56.988026 run osmo-hlr_10.42.42.2(pid=17001): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17001)] 00:06:57.038692 run osmo-hlr_10.42.42.2(pid=17001): stdout: | (launched: 2022-12-14_00:06:53.965950) 00:06:57.090740 run osmo-hlr_10.42.42.2(pid=17001): stderr: | [0;m[1;31m20221214000654166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000654166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000654166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000654167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000654167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000654167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000654179 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000654187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000654187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000654187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:57.163536 run osmo-msc_10.42.42.6(pid=17007): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17007)] 00:06:57.213448 run osmo-msc_10.42.42.6(pid=17007): stdout: | (launched: 2022-12-14_00:06:56.011438) 00:06:57.265345 run osmo-msc_10.42.42.6(pid=17007): stderr: | [0;m[38;5;43m20221214000656331 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000656331 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5ca55b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000656331 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000656331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000656331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000656331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000656333 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000656333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000656334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000656334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:57.317514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17000): Terminating (SIGTERM) 00:06:57.359708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17003): Terminating (SIGTERM) 00:06:57.401790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17006): Terminating (SIGTERM) 00:06:57.444611 --- ParallelTerminationStrategy: PID 17000 died... 00:06:57.465177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17000): Terminated: ok {rc=0} 00:06:57.511652 --- ParallelTerminationStrategy: PID 17003 died... 00:06:57.531638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17003): Terminated: ok {rc=0} 00:06:57.577883 --- ParallelTerminationStrategy: PID 17006 died... 00:06:57.597761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17006): Terminated: ok {rc=0} 00:06:57.686357 bus /sierra_3: Setting Powered False 00:06:58.783258 bus /sierra_3: Setting Powered False 00:06:59.899291 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 00:07:01.049988 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:01.062870 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:07:01.129626 tst mo_mt_call_osmux.py: using LAC 37176 00:07:01.287007 tst mo_mt_call_osmux.py: using RAC 201 00:07:01.412239 tst mo_mt_call_osmux.py: using CellId 37176 00:07:01.575464 tst mo_mt_call_osmux.py: using BVCI 37177 00:07:01.698102 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:01.710921 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:01.723468 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:01.735983 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:01.749912 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:01.763476 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:07:01.906325 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:07:02.056208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:02.534819 run create_hlr_db(pid=17009): Launched 00:07:02.658196 bus /sierra_2: Setting Powered False 00:07:03.718492 run create_hlr_db(pid=17009): Terminated: ok {rc=0} 00:07:04.163226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17011): Launched 00:07:04.490847 run osmo-hlr_10.42.42.2(pid=17012): Launched 00:07:04.616324 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:05.175123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17014): Launched 00:07:05.499604 run osmo-stp_10.42.42.5(pid=17015): Launched 00:07:05.625547 run osmo-msc_10.42.42.6: Starting osmo-msc 00:07:06.210582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17017): Launched 00:07:06.536357 run osmo-msc_10.42.42.6(pid=17018): Launched 00:07:06.717504 run osmo-stp_10.42.42.5(pid=17015): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17015)] 00:07:06.853930 run osmo-stp_10.42.42.5(pid=17015): stdout: | (launched: 2022-12-14_00:07:05.440439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:06.991846 run osmo-stp_10.42.42.5(pid=17015): stderr: | [0;m[38;5;43m20221214000705635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000705636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000705636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000705636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000705637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000705637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000705637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:07.128307 run osmo-stp_10.42.42.5(pid=17015): stdout: | (launched: 2022-12-14_00:07:05.440439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:07.257226 run osmo-stp_10.42.42.5(pid=17015): stderr: | [0;m[38;5;43m20221214000705635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000705636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000705636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000705636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000705637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000705637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000705637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:07.411432 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17015): Process ended prematurely: osmo-stp_10.42.42.5(pid=17015) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17015)] [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 00:07:07.421095 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 00:07:07.448854 run osmo-hlr_10.42.42.2(pid=17012): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17012)] 00:07:07.498991 run osmo-hlr_10.42.42.2(pid=17012): stdout: | (launched: 2022-12-14_00:07:04.430071) 00:07:07.550704 run osmo-hlr_10.42.42.2(pid=17012): stderr: | [0;m[1;31m20221214000704631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000704631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000704631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000704631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000704631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000704631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000704644 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000704652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000704652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000704652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:07.623155 run osmo-msc_10.42.42.6(pid=17018): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17018)] 00:07:07.672632 run osmo-msc_10.42.42.6(pid=17018): stdout: | (launched: 2022-12-14_00:07:06.477101) 00:07:07.724096 run osmo-msc_10.42.42.6(pid=17018): stderr: | [0;m[38;5;43m20221214000706800 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000706801 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff6940d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000706801 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000706801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000706801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000706801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000706803 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000706803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000706803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000706803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:07:07.775708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17011): Terminating (SIGTERM) 00:07:07.817142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17014): Terminating (SIGTERM) 00:07:07.858647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17017): Terminating (SIGTERM) 00:07:07.900751 --- ParallelTerminationStrategy: PID 17011 died... 00:07:07.921296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17011): Terminated: ok {rc=0} 00:07:07.967570 --- ParallelTerminationStrategy: PID 17014 died... 00:07:07.987605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17014): Terminated: ok {rc=0} 00:07:08.033409 --- ParallelTerminationStrategy: PID 17017 died... 00:07:08.053271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17017): Terminated: ok {rc=0} 00:07:08.140483 bus /sierra_3: Setting Powered False 00:07:09.238494 bus /sierra_3: Setting Powered False 00:07:10.353337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 00:07:11.600168 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:07:11.605085 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:07:11.634814 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:07:11.663245 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 00:07:11.750952 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:07:11.780148 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:07:11.806747 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 00:07:12.395202 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2396 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 00:07:12.400723 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:12.412199 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:07:12.458977 tst emergency_mo_mt_call.py: using LAC 37177 00:07:12.582627 tst emergency_mo_mt_call.py: using RAC 202 00:07:12.706579 tst emergency_mo_mt_call.py: using CellId 37177 00:07:12.830662 tst emergency_mo_mt_call.py: using BVCI 37178 00:07:12.947352 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:12.958908 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:12.970069 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:12.981162 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:12.992479 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:13.003931 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:13.121415 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:13.240389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:13.734375 run create_hlr_db(pid=17023): Launched 00:07:13.856769 bus /sierra_2: Setting Powered False 00:07:14.920053 run create_hlr_db(pid=17023): Terminated: ok {rc=0} 00:07:15.365463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17025): Launched 00:07:15.683062 run osmo-hlr_10.42.42.2(pid=17026): Launched 00:07:15.805665 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:16.477676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17028): Launched 00:07:16.817618 run osmo-stp_10.42.42.5(pid=17029): Launched 00:07:17.077343 tst emergency_mo_mt_call.py: using MSISDN 8397 00:07:17.306934 run osmo-msc_10.42.42.6: Starting osmo-msc 00:07:17.883287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17031): Launched 00:07:18.203119 run osmo-msc_10.42.42.6(pid=17032): Launched 00:07:18.383044 run osmo-stp_10.42.42.5(pid=17029): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17029)] 00:07:18.518954 run osmo-stp_10.42.42.5(pid=17029): stdout: | (launched: 2022-12-14_00:07:16.756597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:18.655126 run osmo-stp_10.42.42.5(pid=17029): stderr: | [0;m[38;5;43m20221214000717052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000717052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000717057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000717057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000717058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000717058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000717058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:18.789847 run osmo-stp_10.42.42.5(pid=17029): stdout: | (launched: 2022-12-14_00:07:16.756597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:18.916715 run osmo-stp_10.42.42.5(pid=17029): stderr: | [0;m[38;5;43m20221214000717052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000717052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000717057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000717057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000717058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000717058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000717058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:19.068657 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=17029): Process ended prematurely: osmo-stp_10.42.42.5(pid=17029) [trial-2396↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17029)] [trial-2396↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 00:07:19.077554 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 00:07:19.104888 run osmo-hlr_10.42.42.2(pid=17026): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17026)] 00:07:19.155529 run osmo-hlr_10.42.42.2(pid=17026): stdout: | (launched: 2022-12-14_00:07:15.624875) 00:07:19.207226 run osmo-hlr_10.42.42.2(pid=17026): stderr: | [0;m[1;31m20221214000715824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000715824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000715824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000715824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000715824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000715824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000715835 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000715843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000715844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000715844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:19.279412 run osmo-msc_10.42.42.6(pid=17032): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17032)] 00:07:19.329119 run osmo-msc_10.42.42.6(pid=17032): stdout: | (launched: 2022-12-14_00:07:18.145041) 00:07:19.380581 run osmo-msc_10.42.42.6(pid=17032): stderr: | [0;m[38;5;43m20221214000718464 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000718464 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0b3cea5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000718465 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000718465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000718465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000718465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000718467 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000718467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000718467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000718467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:07:19.432607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17025): Terminating (SIGTERM) 00:07:19.474381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17028): Terminating (SIGTERM) 00:07:19.515981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17031): Terminating (SIGTERM) 00:07:19.558616 --- ParallelTerminationStrategy: PID 17025 died... 00:07:19.578910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17025): Terminated: ok {rc=0} 00:07:19.624936 --- ParallelTerminationStrategy: PID 17028 died... 00:07:19.644779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17028): Terminated: ok {rc=0} 00:07:19.690671 --- ParallelTerminationStrategy: PID 17031 died... 00:07:19.710542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17031): Terminated: ok {rc=0} 00:07:19.797790 bus /sierra_3: Setting Powered False 00:07:20.895607 bus /sierra_3: Setting Powered False 00:07:22.010948 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 00:07:23.096917 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:23.109131 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:07:23.160602 tst emergency_preemptive_call.py: using LAC 37178 00:07:23.280787 tst emergency_preemptive_call.py: using RAC 203 00:07:23.397417 tst emergency_preemptive_call.py: using CellId 37178 00:07:23.515603 tst emergency_preemptive_call.py: using BVCI 37179 00:07:23.623170 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:23.634112 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:23.644693 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:23.655304 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:23.666116 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:23.677161 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:23.791675 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:23.912021 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:24.031716 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:24.146083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:24.607430 run create_hlr_db(pid=17034): Launched 00:07:24.730042 bus /sierra_2: Setting Powered False 00:07:25.793617 run create_hlr_db(pid=17034): Terminated: ok {rc=0} 00:07:26.238483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17036): Launched 00:07:26.557658 run osmo-hlr_10.42.42.2(pid=17037): Launched 00:07:26.681349 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:27.226615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17039): Launched 00:07:27.545707 run osmo-stp_10.42.42.5(pid=17040): Launched 00:07:27.673352 tst emergency_preemptive_call.py: using MSISDN 8398 00:07:27.826468 run osmo-msc_10.42.42.6: Starting osmo-msc 00:07:28.359344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17042): Launched 00:07:28.655301 run osmo-msc_10.42.42.6(pid=17043): Launched 00:07:28.820526 run osmo-stp_10.42.42.5(pid=17040): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17040)] 00:07:28.946579 run osmo-stp_10.42.42.5(pid=17040): stdout: | (launched: 2022-12-14_00:07:27.485739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:29.073272 run osmo-stp_10.42.42.5(pid=17040): stderr: | [0;m[38;5;43m20221214000727665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000727665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000727665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000727665 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000727666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000727666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000727666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:29.197799 run osmo-stp_10.42.42.5(pid=17040): stdout: | (launched: 2022-12-14_00:07:27.485739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:29.316362 run osmo-stp_10.42.42.5(pid=17040): stderr: | [0;m[38;5;43m20221214000727665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000727665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000727665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000727665 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000727666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000727666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000727666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:29.457411 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=17040): Process ended prematurely: osmo-stp_10.42.42.5(pid=17040) [trial-2396↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17040)] [trial-2396↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 00:07:29.465530 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 00:07:29.491392 run osmo-hlr_10.42.42.2(pid=17037): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17037)] 00:07:29.539082 run osmo-hlr_10.42.42.2(pid=17037): stdout: | (launched: 2022-12-14_00:07:26.499417) 00:07:29.587807 run osmo-hlr_10.42.42.2(pid=17037): stderr: | [0;m[1;31m20221214000726697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000726697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000726697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000726697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000726697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000726697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000726721 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000726730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000726730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000726730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:29.656278 run osmo-msc_10.42.42.6(pid=17043): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17043)] 00:07:29.703280 run osmo-msc_10.42.42.6(pid=17043): stdout: | (launched: 2022-12-14_00:07:28.600695) 00:07:29.752514 run osmo-msc_10.42.42.6(pid=17043): stderr: | [0;m[38;5;43m20221214000728872 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214000728872 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fae8e039c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214000728872 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214000728872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214000728872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214000728873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214000728874 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214000728875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214000728875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214000728875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:07:29.801544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17036): Terminating (SIGTERM) 00:07:29.840466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17039): Terminating (SIGTERM) 00:07:29.879460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17042): Terminating (SIGTERM) 00:07:29.918832 --- ParallelTerminationStrategy: PID 17036 died... 00:07:29.937860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17036): Terminated: ok {rc=0} 00:07:29.981176 --- ParallelTerminationStrategy: PID 17039 died... 00:07:29.999589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17039): Terminated: ok {rc=0} 00:07:30.042988 --- ParallelTerminationStrategy: PID 17042 died... 00:07:30.061379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17042): Terminated: ok {rc=0} 00:07:30.145199 bus /sierra_9: Setting Powered False 00:07:31.248543 bus /sierra_9: Setting Powered False 00:07:32.373093 bus /sierra_8: Setting Powered False 00:07:33.470392 bus /sierra_8: Setting Powered False 00:07:34.582606 bus /sierra_3: Setting Powered False 00:07:35.680286 bus /sierra_3: Setting Powered False 00:07:36.796321 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 00:07:38.074190 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:07:38.079092 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:07:38.108798 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 00:07:38.149277 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 00:07:38.237873 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:07:38.267785 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 00:07:38.307602 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 00:07:38.902438 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 00:07:38.956359 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:38.967734 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:07:39.014269 tst cs_paging_gprs_active.py: using LAC 37179 00:07:39.143335 tst cs_paging_gprs_active.py: using RAC 204 00:07:39.271269 tst cs_paging_gprs_active.py: using CellId 37179 00:07:39.398514 tst cs_paging_gprs_active.py: using BVCI 37180 00:07:39.517636 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:39.528935 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:39.540091 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:39.551105 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:39.562442 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:39.573796 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:39.585347 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:39.596562 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:39.608060 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:39.725503 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:39.844769 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:07:40.067169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:07:40.394017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17048): Launched 00:07:40.678495 run iperf3-srv_10.42.42.10(pid=17049): Launched 00:07:40.800008 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:07:41.019976 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:07:41.346704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17050): Launched 00:07:41.629329 run iperf3-srv_10.42.42.10(pid=17051): Launched 00:07:41.752080 tst cs_paging_gprs_active.py:38: start network... 00:07:41.972627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:42.475834 run create_hlr_db(pid=17052): Launched 00:07:42.600235 bus /sierra_2: Setting Powered False 00:07:43.664886 run create_hlr_db(pid=17052): Terminated: ok {rc=0} 00:07:44.116859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17054): Launched 00:07:44.442320 run osmo-hlr_10.42.42.2(pid=17055): Launched 00:07:44.568657 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:45.128637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17057): Launched 00:07:45.454576 run osmo-stp_10.42.42.5(pid=17058): Launched 00:07:45.578287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:07:46.157250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17060): Launched 00:07:46.288871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:07:46.555915 run patchelf(pid=17061): Launched 00:07:46.746533 run osmo-stp_10.42.42.5(pid=17058): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17058)] 00:07:46.878194 run osmo-stp_10.42.42.5(pid=17058): stdout: | (launched: 2022-12-14_00:07:45.395153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:47.016243 run osmo-stp_10.42.42.5(pid=17058): stderr: | [0;m[38;5;43m20221214000745589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000745589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000745590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000745590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000745590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000745590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000745591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:47.152222 run osmo-stp_10.42.42.5(pid=17058): stdout: | (launched: 2022-12-14_00:07:45.395153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:47.278243 run osmo-stp_10.42.42.5(pid=17058): stderr: | [0;m[38;5;43m20221214000745589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000745589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000745590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000745590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000745590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000745590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000745591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:47.427040 run patchelf(pid=17061): Terminating (SIGINT) 00:07:47.598226 run patchelf(pid=17061): Terminated: ok {rc=0} 00:07:47.721267 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17058): Process ended prematurely: osmo-stp_10.42.42.5(pid=17058) [trial-2396↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17058)] [trial-2396↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 00:07:47.731077 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 00:07:47.758606 run osmo-hlr_10.42.42.2(pid=17055): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17055)] 00:07:47.806539 run osmo-hlr_10.42.42.2(pid=17055): stdout: | (launched: 2022-12-14_00:07:44.383165) 00:07:47.855869 run osmo-hlr_10.42.42.2(pid=17055): stderr: | [0;m[1;31m20221214000744584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000744584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000744584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000744584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000744584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000744584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000744599 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000744608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000744608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000744608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:47.905561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17048): Terminating (SIGTERM) 00:07:47.945551 run iperf3-srv_10.42.42.10(pid=17049): Terminating (SIGTERM) 00:07:47.985037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17050): Terminating (SIGTERM) 00:07:48.024617 run iperf3-srv_10.42.42.10(pid=17051): Terminating (SIGTERM) 00:07:48.064003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17054): Terminating (SIGTERM) 00:07:48.103733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17057): Terminating (SIGTERM) 00:07:48.143486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17060): Terminating (SIGTERM) 00:07:48.183535 --- ParallelTerminationStrategy: PID 17048 died... 00:07:48.203052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17048): Terminated: ok {rc=0} 00:07:48.247265 --- ParallelTerminationStrategy: PID 17049 died... 00:07:48.266589 run iperf3-srv_10.42.42.10(pid=17049): Terminated {rc=256} 00:07:48.310469 --- ParallelTerminationStrategy: PID 17050 died... 00:07:48.329455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17050): Terminated: ok {rc=0} 00:07:48.373545 --- ParallelTerminationStrategy: PID 17051 died... 00:07:48.392471 run iperf3-srv_10.42.42.10(pid=17051): Terminated {rc=256} 00:07:48.436307 --- ParallelTerminationStrategy: PID 17054 died... 00:07:48.455281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17054): Terminated: ok {rc=0} 00:07:48.499114 --- ParallelTerminationStrategy: PID 17057 died... 00:07:48.517979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17057): Terminated: ok {rc=0} 00:07:48.561760 --- ParallelTerminationStrategy: PID 17060 died... 00:07:48.580600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17060): Terminated: ok {rc=0} 00:07:48.665594 bus /gobi_0: Setting Powered False 00:07:49.763839 bus /gobi_0: Setting Powered False 00:07:50.875238 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 00:07:52.017900 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:52.029528 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:07:52.077240 tst iperf3.py: using LAC 37180 00:07:52.197424 tst iperf3.py: using RAC 205 00:07:52.316797 tst iperf3.py: using CellId 37180 00:07:52.440141 tst iperf3.py: using BVCI 37181 00:07:52.552094 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:52.563173 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:52.573951 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:52.584440 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:52.594975 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:52.605510 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:52.616564 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:52.627649 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:52.638300 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:52.752202 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:07:52.956052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:07:53.260624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17063): Launched 00:07:53.524882 run iperf3-srv_10.42.42.10(pid=17064): Launched 00:07:53.638120 tst iperf3.py:8: start network... 00:07:53.840357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:54.308778 run create_hlr_db(pid=17065): Launched 00:07:54.431336 bus /gobi_6: Setting Powered False 00:07:55.491382 run create_hlr_db(pid=17065): Terminated: ok {rc=0} 00:07:55.933861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17067): Launched 00:07:56.256917 run osmo-hlr_10.42.42.2(pid=17068): Launched 00:07:56.380890 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:56.941408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17070): Launched 00:07:57.266230 run osmo-stp_10.42.42.5(pid=17071): Launched 00:07:57.391452 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:07:57.952315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17073): Launched 00:07:58.076998 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:07:58.350737 run patchelf(pid=17074): Launched 00:07:58.531855 run osmo-stp_10.42.42.5(pid=17071): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17071)] 00:07:58.668877 run osmo-stp_10.42.42.5(pid=17071): stdout: | (launched: 2022-12-14_00:07:57.206974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:58.807584 run osmo-stp_10.42.42.5(pid=17071): stderr: | [0;m[38;5;43m20221214000757399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000757399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000757399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000757400 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000757402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000757402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000757402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:58.947299 run osmo-stp_10.42.42.5(pid=17071): stdout: | (launched: 2022-12-14_00:07:57.206974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:59.080174 run osmo-stp_10.42.42.5(pid=17071): stderr: | [0;m[38;5;43m20221214000757399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000757399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000757399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000757400 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000757402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000757402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000757402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:59.237460 run patchelf(pid=17074): Terminating (SIGINT) 00:07:59.419576 run patchelf(pid=17074): Terminated: ok {rc=0} 00:07:59.551079 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17071): Process ended prematurely: osmo-stp_10.42.42.5(pid=17071) [trial-2396↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17071)] [trial-2396↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 00:07:59.561156 tst iperf3.py:8: Test FAILED (7.6 sec) 00:07:59.589481 run osmo-hlr_10.42.42.2(pid=17068): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17068)] 00:07:59.639699 run osmo-hlr_10.42.42.2(pid=17068): stdout: | (launched: 2022-12-14_00:07:56.197754) 00:07:59.691229 run osmo-hlr_10.42.42.2(pid=17068): stderr: | [0;m[1;31m20221214000756397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000756397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000756397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000756397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000756397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000756397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000756410 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000756418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000756418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000756418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:59.742587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17063): Terminating (SIGTERM) 00:07:59.783919 run iperf3-srv_10.42.42.10(pid=17064): Terminating (SIGTERM) 00:07:59.825007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17067): Terminating (SIGTERM) 00:07:59.866316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17070): Terminating (SIGTERM) 00:07:59.907526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17073): Terminating (SIGTERM) 00:07:59.949984 --- ParallelTerminationStrategy: PID 17063 died... 00:07:59.970247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17063): Terminated: ok {rc=0} 00:08:00.017050 --- ParallelTerminationStrategy: PID 17064 died... 00:08:00.037056 run iperf3-srv_10.42.42.10(pid=17064): Terminated {rc=256} 00:08:00.083256 --- ParallelTerminationStrategy: PID 17067 died... 00:08:00.103252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17067): Terminated: ok {rc=0} 00:08:00.149711 --- ParallelTerminationStrategy: PID 17070 died... 00:08:00.169530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17070): Terminated: ok {rc=0} 00:08:00.215695 --- ParallelTerminationStrategy: PID 17073 died... 00:08:00.235511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17073): Terminated: ok {rc=0} 00:08:00.322503 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 00:08:01.473538 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:01.486555 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:08:01.534456 tst iperf3m4.py: using LAC 37181 00:08:01.664381 tst iperf3m4.py: using RAC 206 00:08:01.822360 tst iperf3m4.py: using CellId 37181 00:08:01.952425 tst iperf3m4.py: using BVCI 37182 00:08:02.109810 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:02.125296 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:02.137796 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:02.149836 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:02.162381 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:02.175464 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:02.188373 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:02.200929 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:02.213889 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:02.336592 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:02.456407 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:02.575422 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:02.699203 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:08:02.918340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:03.244141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17075): Launched 00:08:03.526828 run iperf3-srv_10.42.42.10(pid=17076): Launched 00:08:03.648697 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:08:03.868679 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:04.195159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17077): Launched 00:08:04.478951 run iperf3-srv_10.42.42.10(pid=17078): Launched 00:08:04.600481 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:08:04.818902 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:05.144301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17079): Launched 00:08:05.427508 run iperf3-srv_10.42.42.10(pid=17080): Launched 00:08:05.551272 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:08:05.770191 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:06.096595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17081): Launched 00:08:06.378596 run iperf3-srv_10.42.42.10(pid=17082): Launched 00:08:06.501976 tst iperf3m4.py:8: start network... 00:08:06.721465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:07.223991 run create_hlr_db(pid=17083): Launched 00:08:07.348622 bus /gobi_6: Setting Powered False 00:08:08.413182 run create_hlr_db(pid=17083): Terminated: ok {rc=0} 00:08:08.864028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17085): Launched 00:08:09.189019 run osmo-hlr_10.42.42.2(pid=17086): Launched 00:08:09.314984 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:09.977119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17088): Launched 00:08:10.294268 run osmo-stp_10.42.42.5(pid=17089): Launched 00:08:10.417577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:10.966648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17091): Launched 00:08:11.088307 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:11.356182 run patchelf(pid=17092): Launched 00:08:11.532042 run osmo-stp_10.42.42.5(pid=17089): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17089)] 00:08:11.666816 run osmo-stp_10.42.42.5(pid=17089): stdout: | (launched: 2022-12-14_00:08:10.236394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:11.802772 run osmo-stp_10.42.42.5(pid=17089): stderr: | [0;m[38;5;43m20221214000810427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000810428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000810428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000810428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000810429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000810429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000810429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:11.939047 run osmo-stp_10.42.42.5(pid=17089): stdout: | (launched: 2022-12-14_00:08:10.236394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:12.069310 run osmo-stp_10.42.42.5(pid=17089): stderr: | [0;m[38;5;43m20221214000810427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000810428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000810428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000810428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000810429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000810429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000810429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:12.223545 run patchelf(pid=17092): Terminating (SIGINT) 00:08:12.402198 run patchelf(pid=17092): Terminated: ok {rc=0} 00:08:12.530659 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17089): Process ended prematurely: osmo-stp_10.42.42.5(pid=17089) [trial-2396↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17089)] [trial-2396↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 00:08:12.540700 tst iperf3m4.py:8: Test FAILED (11.1 sec) 00:08:12.569415 run osmo-hlr_10.42.42.2(pid=17086): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17086)] 00:08:12.619655 run osmo-hlr_10.42.42.2(pid=17086): stdout: | (launched: 2022-12-14_00:08:09.129467) 00:08:12.671628 run osmo-hlr_10.42.42.2(pid=17086): stderr: | [0;m[1;31m20221214000809328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000809328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000809328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000809328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000809328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000809328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000809340 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000809350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000809350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000809350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:12.723468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17075): Terminating (SIGTERM) 00:08:12.765100 run iperf3-srv_10.42.42.10(pid=17076): Terminating (SIGTERM) 00:08:12.806418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17077): Terminating (SIGTERM) 00:08:12.848457 run iperf3-srv_10.42.42.10(pid=17078): Terminating (SIGTERM) 00:08:12.890217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17079): Terminating (SIGTERM) 00:08:12.931877 run iperf3-srv_10.42.42.10(pid=17080): Terminating (SIGTERM) 00:08:12.972923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17081): Terminating (SIGTERM) 00:08:13.014364 run iperf3-srv_10.42.42.10(pid=17082): Terminating (SIGTERM) 00:08:13.055651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17085): Terminating (SIGTERM) 00:08:13.097086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17088): Terminating (SIGTERM) 00:08:13.138270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17091): Terminating (SIGTERM) 00:08:13.179803 --- ParallelTerminationStrategy: PID 17075 died... 00:08:13.199924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17075): Terminated: ok {rc=0} 00:08:13.245771 --- ParallelTerminationStrategy: PID 17076 died... 00:08:13.265444 run iperf3-srv_10.42.42.10(pid=17076): Terminated {rc=256} 00:08:13.311162 --- ParallelTerminationStrategy: PID 17077 died... 00:08:13.330885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17077): Terminated: ok {rc=0} 00:08:13.376611 --- ParallelTerminationStrategy: PID 17078 died... 00:08:13.396281 run iperf3-srv_10.42.42.10(pid=17078): Terminated {rc=256} 00:08:13.441838 --- ParallelTerminationStrategy: PID 17079 died... 00:08:13.461680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17079): Terminated: ok {rc=0} 00:08:13.507498 --- ParallelTerminationStrategy: PID 17080 died... 00:08:13.527225 run iperf3-srv_10.42.42.10(pid=17080): Terminated {rc=256} 00:08:13.572885 --- ParallelTerminationStrategy: PID 17081 died... 00:08:13.593047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17081): Terminated: ok {rc=0} 00:08:13.638705 --- ParallelTerminationStrategy: PID 17082 died... 00:08:13.658545 run iperf3-srv_10.42.42.10(pid=17082): Terminated {rc=256} 00:08:13.704091 --- ParallelTerminationStrategy: PID 17085 died... 00:08:13.723825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17085): Terminated: ok {rc=0} 00:08:13.769504 --- ParallelTerminationStrategy: PID 17088 died... 00:08:13.789196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17088): Terminated: ok {rc=0} 00:08:13.834835 --- ParallelTerminationStrategy: PID 17091 died... 00:08:13.854558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17091): Terminated: ok {rc=0} 00:08:13.942081 bus /gobi_4: Setting Powered False 00:08:15.039869 bus /gobi_4: Setting Powered False 00:08:16.163302 bus /gobi_1: Setting Powered False 00:08:17.267872 bus /gobi_1: Setting Powered False 00:08:18.382771 bus /gobi_0: Setting Powered False 00:08:19.480255 bus /gobi_0: Setting Powered False 00:08:20.597889 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 00:08:21.699693 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:21.711087 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:08:21.756525 tst ping.py: using LAC 37182 00:08:21.879415 tst ping.py: using RAC 207 00:08:22.006927 tst ping.py: using CellId 37182 00:08:22.129848 tst ping.py: using BVCI 37183 00:08:22.242337 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:22.253654 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:22.264742 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:22.275862 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:22.287575 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:22.298897 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:22.310329 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:22.321704 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:22.437061 tst ping.py:19: start network... 00:08:22.634050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:23.087679 run create_hlr_db(pid=17093): Launched 00:08:23.208180 bus /gobi_6: Setting Powered False 00:08:24.265584 run create_hlr_db(pid=17093): Terminated: ok {rc=0} 00:08:24.695761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17095): Launched 00:08:25.009260 run osmo-hlr_10.42.42.2(pid=17096): Launched 00:08:25.128935 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:25.670901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17098): Launched 00:08:25.982512 run osmo-stp_10.42.42.5(pid=17099): Launched 00:08:26.103329 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:26.641945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17101): Launched 00:08:26.763013 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:27.028174 run patchelf(pid=17102): Launched 00:08:27.201244 run osmo-stp_10.42.42.5(pid=17099): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17099)] 00:08:27.333600 run osmo-stp_10.42.42.5(pid=17099): stdout: | (launched: 2022-12-14_00:08:25.925218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:27.467460 run osmo-stp_10.42.42.5(pid=17099): stderr: | [0;m[38;5;43m20221214000826115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000826115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000826115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000826116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000826116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000826116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000826116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:27.601338 run osmo-stp_10.42.42.5(pid=17099): stdout: | (launched: 2022-12-14_00:08:25.925218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:27.730580 run osmo-stp_10.42.42.5(pid=17099): stderr: | [0;m[38;5;43m20221214000826115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000826115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000826115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000826116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000826116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000826116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000826116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:27.882740 run patchelf(pid=17102): Terminating (SIGINT) 00:08:28.058518 run patchelf(pid=17102): Terminated: ok {rc=0} 00:08:28.184646 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17099): Process ended prematurely: osmo-stp_10.42.42.5(pid=17099) [trial-2396↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17099)] [trial-2396↪gprs:trx-lms-limenet-micro↪ping.py:22] 00:08:28.194217 tst ping.py:22: Test FAILED (6.5 sec) 00:08:28.221730 run osmo-hlr_10.42.42.2(pid=17096): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17096)] 00:08:28.271729 run osmo-hlr_10.42.42.2(pid=17096): stdout: | (launched: 2022-12-14_00:08:24.952126) 00:08:28.323189 run osmo-hlr_10.42.42.2(pid=17096): stderr: | [0;m[1;31m20221214000825150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000825151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000825151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000825151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000825151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000825151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000825163 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000825171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000825172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000825172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:28.375128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17095): Terminating (SIGTERM) 00:08:28.416370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17098): Terminating (SIGTERM) 00:08:28.457861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17101): Terminating (SIGTERM) 00:08:28.499335 --- ParallelTerminationStrategy: PID 17095 died... 00:08:28.519290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17095): Terminated: ok {rc=0} 00:08:28.565097 --- ParallelTerminationStrategy: PID 17098 died... 00:08:28.584559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17098): Terminated: ok {rc=0} 00:08:28.630277 --- ParallelTerminationStrategy: PID 17101 died... 00:08:28.649861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17101): Terminated: ok {rc=0} 00:08:28.736625 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 00:08:29.823531 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:29.835475 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:08:29.880933 tst ping_idle_ping.py: using LAC 37183 00:08:30.003378 tst ping_idle_ping.py: using RAC 208 00:08:30.126876 tst ping_idle_ping.py: using CellId 37183 00:08:30.250083 tst ping_idle_ping.py: using BVCI 37184 00:08:30.365566 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:30.376923 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:30.388319 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:30.399406 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:30.410681 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:30.422125 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:30.433582 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:30.444770 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:30.564005 tst ping_idle_ping.py:24: start network... 00:08:30.762945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:31.260534 run create_hlr_db(pid=17103): Launched 00:08:31.427003 bus /gobi_6: Setting Powered False 00:08:32.486251 run create_hlr_db(pid=17103): Terminated: ok {rc=0} 00:08:32.927635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17105): Launched 00:08:33.225754 run osmo-hlr_10.42.42.2(pid=17106): Launched 00:08:33.336601 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:33.844412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17108): Launched 00:08:34.139430 run osmo-stp_10.42.42.5(pid=17109): Launched 00:08:34.251529 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:34.760756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17111): Launched 00:08:34.873366 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:35.122216 run patchelf(pid=17112): Launched 00:08:35.285870 run osmo-stp_10.42.42.5(pid=17109): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17109)] 00:08:35.410827 run osmo-stp_10.42.42.5(pid=17109): stdout: | (launched: 2022-12-14_00:08:34.085246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:35.537608 run osmo-stp_10.42.42.5(pid=17109): stderr: | [0;m[38;5;43m20221214000834256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000834256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000834256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000834257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000834257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000834257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000834257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:35.664559 run osmo-stp_10.42.42.5(pid=17109): stdout: | (launched: 2022-12-14_00:08:34.085246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:35.786285 run osmo-stp_10.42.42.5(pid=17109): stderr: | [0;m[38;5;43m20221214000834256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000834256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000834256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000834257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000834257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000834257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000834257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:35.930029 run patchelf(pid=17112): Terminating (SIGINT) 00:08:36.096111 run patchelf(pid=17112): Terminated: ok {rc=0} 00:08:36.215602 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17109): Process ended prematurely: osmo-stp_10.42.42.5(pid=17109) [trial-2396↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17109)] [trial-2396↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 00:08:36.224341 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:08:36.250491 run osmo-hlr_10.42.42.2(pid=17106): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17106)] 00:08:36.297998 run osmo-hlr_10.42.42.2(pid=17106): stdout: | (launched: 2022-12-14_00:08:33.171937) 00:08:36.346657 run osmo-hlr_10.42.42.2(pid=17106): stderr: | [0;m[1;31m20221214000833348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000833348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000833348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000833348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000833348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000833349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000833366 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000833375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000833375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000833375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:36.395939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17105): Terminating (SIGTERM) 00:08:36.435234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17108): Terminating (SIGTERM) 00:08:36.474391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17111): Terminating (SIGTERM) 00:08:36.513818 --- ParallelTerminationStrategy: PID 17105 died... 00:08:36.532403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17105): Terminated: ok {rc=0} 00:08:36.576247 --- ParallelTerminationStrategy: PID 17108 died... 00:08:36.594855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17108): Terminated: ok {rc=0} 00:08:36.637894 --- ParallelTerminationStrategy: PID 17111 died... 00:08:36.656682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17111): Terminated: ok {rc=0} 00:08:36.738789 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 00:08:38.043961 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:08:38.050267 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:08:38.078981 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:08:38.117367 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:08:38.204993 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:08:38.234686 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:08:38.272625 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:08:38.866757 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:08:38.915023 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:38.926159 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:08:38.972046 tst cs_paging_gprs_active.py: using LAC 37184 00:08:39.090944 tst cs_paging_gprs_active.py: using RAC 209 00:08:39.210516 tst cs_paging_gprs_active.py: using CellId 37184 00:08:39.329072 tst cs_paging_gprs_active.py: using BVCI 37185 00:08:39.437327 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:39.448295 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:39.459041 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:39.469931 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:39.480450 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:39.491270 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:39.502159 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:39.512813 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:39.524207 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:08:39.645873 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:08:39.765965 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:08:39.983205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:40.303343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17116): Launched 00:08:40.581204 run iperf3-srv_10.42.42.10(pid=17117): Launched 00:08:40.701795 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:08:40.916899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:41.238064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17118): Launched 00:08:41.515553 run iperf3-srv_10.42.42.10(pid=17119): Launched 00:08:41.634980 tst cs_paging_gprs_active.py:38: start network... 00:08:41.850492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:42.346517 run create_hlr_db(pid=17120): Launched 00:08:42.468789 bus /gobi_6: Setting Powered False 00:08:43.532327 run create_hlr_db(pid=17120): Terminated: ok {rc=0} 00:08:43.962177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17122): Launched 00:08:44.262674 run osmo-hlr_10.42.42.2(pid=17123): Launched 00:08:44.377568 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:44.894013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17125): Launched 00:08:45.193643 run osmo-stp_10.42.42.5(pid=17126): Launched 00:08:45.308017 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:45.831048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17128): Launched 00:08:45.973933 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:46.258360 run patchelf(pid=17129): Launched 00:08:46.454126 run osmo-stp_10.42.42.5(pid=17126): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17126)] 00:08:46.596034 run osmo-stp_10.42.42.5(pid=17126): stdout: | (launched: 2022-12-14_00:08:45.138491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:46.737520 run osmo-stp_10.42.42.5(pid=17126): stderr: | [0;m[38;5;43m20221214000845308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000845308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000845308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000845309 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000845309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000845309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000845309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:46.880465 run osmo-stp_10.42.42.5(pid=17126): stdout: | (launched: 2022-12-14_00:08:45.138491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:47.017986 run osmo-stp_10.42.42.5(pid=17126): stderr: | [0;m[38;5;43m20221214000845308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000845308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000845308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000845309 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000845309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000845309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000845309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:47.180163 run patchelf(pid=17129): Terminating (SIGINT) 00:08:47.359667 run patchelf(pid=17129): Terminated: ok {rc=0} 00:08:47.489554 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17126): Process ended prematurely: osmo-stp_10.42.42.5(pid=17126) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17126)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:08:47.499964 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 00:08:47.528713 run osmo-hlr_10.42.42.2(pid=17123): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17123)] 00:08:47.579412 run osmo-hlr_10.42.42.2(pid=17123): stdout: | (launched: 2022-12-14_00:08:44.207203) 00:08:47.631880 run osmo-hlr_10.42.42.2(pid=17123): stderr: | [0;m[1;31m20221214000844383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000844383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000844383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000844383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000844383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000844383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000844396 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000844406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000844406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000844407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:47.684065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17116): Terminating (SIGTERM) 00:08:47.725743 run iperf3-srv_10.42.42.10(pid=17117): Terminating (SIGTERM) 00:08:47.767088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17118): Terminating (SIGTERM) 00:08:47.809214 run iperf3-srv_10.42.42.10(pid=17119): Terminating (SIGTERM) 00:08:47.850982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17122): Terminating (SIGTERM) 00:08:47.893464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17125): Terminating (SIGTERM) 00:08:47.935311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17128): Terminating (SIGTERM) 00:08:47.977416 --- ParallelTerminationStrategy: PID 17116 died... 00:08:47.998284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17116): Terminated: ok {rc=0} 00:08:48.044465 --- ParallelTerminationStrategy: PID 17117 died... 00:08:48.064026 run iperf3-srv_10.42.42.10(pid=17117): Terminated {rc=256} 00:08:48.109736 --- ParallelTerminationStrategy: PID 17118 died... 00:08:48.129631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17118): Terminated: ok {rc=0} 00:08:48.175373 --- ParallelTerminationStrategy: PID 17119 died... 00:08:48.195096 run iperf3-srv_10.42.42.10(pid=17119): Terminated {rc=256} 00:08:48.241090 --- ParallelTerminationStrategy: PID 17122 died... 00:08:48.260630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17122): Terminated: ok {rc=0} 00:08:48.306468 --- ParallelTerminationStrategy: PID 17125 died... 00:08:48.326332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17125): Terminated: ok {rc=0} 00:08:48.372517 --- ParallelTerminationStrategy: PID 17128 died... 00:08:48.392436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17128): Terminated: ok {rc=0} 00:08:48.480647 bus /gobi_0: Setting Powered False 00:08:49.579152 bus /gobi_0: Setting Powered False 00:08:50.693903 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:08:51.839756 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:51.851967 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:08:51.900532 tst iperf3.py: using LAC 37185 00:08:52.019070 tst iperf3.py: using RAC 210 00:08:52.137152 tst iperf3.py: using CellId 37185 00:08:52.256417 tst iperf3.py: using BVCI 37186 00:08:52.364760 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:52.375874 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:52.386899 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:52.397859 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:52.408688 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:52.419688 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:52.430719 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:52.441539 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:52.452433 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:08:52.572309 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:08:52.774666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:53.075337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17130): Launched 00:08:53.335079 run iperf3-srv_10.42.42.10(pid=17131): Launched 00:08:53.447144 tst iperf3.py:8: start network... 00:08:53.647706 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:54.111851 run create_hlr_db(pid=17132): Launched 00:08:54.235882 bus /gobi_6: Setting Powered False 00:08:55.296316 run create_hlr_db(pid=17132): Terminated: ok {rc=0} 00:08:55.714457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17134): Launched 00:08:56.015288 run osmo-hlr_10.42.42.2(pid=17135): Launched 00:08:56.128457 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:56.659708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17137): Launched 00:08:56.958195 run osmo-stp_10.42.42.5(pid=17138): Launched 00:08:57.071425 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:57.586653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17140): Launched 00:08:57.700125 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:57.953638 run patchelf(pid=17141): Launched 00:08:58.119241 run osmo-stp_10.42.42.5(pid=17138): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17138)] 00:08:58.245526 run osmo-stp_10.42.42.5(pid=17138): stdout: | (launched: 2022-12-14_00:08:56.903268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:58.373334 run osmo-stp_10.42.42.5(pid=17138): stderr: | [0;m[38;5;43m20221214000857074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000857074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000857075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000857075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000857076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000857076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000857076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:58.501086 run osmo-stp_10.42.42.5(pid=17138): stdout: | (launched: 2022-12-14_00:08:56.903268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:58.623148 run osmo-stp_10.42.42.5(pid=17138): stderr: | [0;m[38;5;43m20221214000857074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000857074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000857075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000857075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000857076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000857076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000857076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:58.767571 run patchelf(pid=17141): Terminating (SIGINT) 00:08:58.935247 run patchelf(pid=17141): Terminated: ok {rc=0} 00:08:59.056094 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17138): Process ended prematurely: osmo-stp_10.42.42.5(pid=17138) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17138)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 00:08:59.066028 tst iperf3.py:8: Test FAILED (7.3 sec) 00:08:59.092646 run osmo-hlr_10.42.42.2(pid=17135): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17135)] 00:08:59.139732 run osmo-hlr_10.42.42.2(pid=17135): stdout: | (launched: 2022-12-14_00:08:55.959651) 00:08:59.188353 run osmo-hlr_10.42.42.2(pid=17135): stderr: | [0;m[1;31m20221214000856138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000856138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000856138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000856138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000856138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000856138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000856151 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000856161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000856162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000856162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:59.237468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17130): Terminating (SIGTERM) 00:08:59.276852 run iperf3-srv_10.42.42.10(pid=17131): Terminating (SIGTERM) 00:08:59.316044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17134): Terminating (SIGTERM) 00:08:59.355262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17137): Terminating (SIGTERM) 00:08:59.394481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17140): Terminating (SIGTERM) 00:08:59.433857 --- ParallelTerminationStrategy: PID 17130 died... 00:08:59.452229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17130): Terminated: ok {rc=0} 00:08:59.495602 --- ParallelTerminationStrategy: PID 17131 died... 00:08:59.513995 run iperf3-srv_10.42.42.10(pid=17131): Terminated {rc=256} 00:08:59.556843 --- ParallelTerminationStrategy: PID 17134 died... 00:08:59.575315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17134): Terminated: ok {rc=0} 00:08:59.618558 --- ParallelTerminationStrategy: PID 17137 died... 00:08:59.636808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17137): Terminated: ok {rc=0} 00:08:59.680102 --- ParallelTerminationStrategy: PID 17140 died... 00:08:59.698569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17140): Terminated: ok {rc=0} 00:08:59.783784 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:09:00.958471 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:00.971966 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:09:01.027779 tst iperf3m4.py: using LAC 37186 00:09:01.149124 tst iperf3m4.py: using RAC 211 00:09:01.273159 tst iperf3m4.py: using CellId 37186 00:09:01.419010 tst iperf3m4.py: using BVCI 37187 00:09:01.555974 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:01.567792 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:01.583469 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:01.595256 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:01.607434 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:01.622008 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:01.634293 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:01.647652 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:01.659876 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:01.803163 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:01.939784 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:02.090115 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:02.240756 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:09:02.505510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:02.900049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17216): Launched 00:09:03.275991 run iperf3-srv_10.42.42.10(pid=17239): Launched 00:09:03.430421 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:09:03.680200 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:04.082740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17325): Launched 00:09:04.449614 run iperf3-srv_10.42.42.10(pid=17371): Launched 00:09:04.605620 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:09:04.857153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:05.163702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17416): Launched 00:09:05.463596 run iperf3-srv_10.42.42.10(pid=17417): Launched 00:09:05.602681 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:09:05.825748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:06.160444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17418): Launched 00:09:06.457258 run iperf3-srv_10.42.42.10(pid=17419): Launched 00:09:06.595289 tst iperf3m4.py:8: start network... 00:09:06.816328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:07.325870 run create_hlr_db(pid=17422): Launched 00:09:07.490370 bus /gobi_6: Setting Powered False 00:09:08.554560 run create_hlr_db(pid=17422): Terminated: ok {rc=0} 00:09:09.013974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17424): Launched 00:09:09.354114 run osmo-hlr_10.42.42.2(pid=17425): Launched 00:09:09.596110 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:10.277657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17427): Launched 00:09:10.621746 run osmo-stp_10.42.42.5(pid=17428): Launched 00:09:10.872225 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:11.518448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17430): Launched 00:09:11.655369 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:11.934885 run patchelf(pid=17431): Launched 00:09:12.135051 run osmo-stp_10.42.42.5(pid=17428): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17428)] 00:09:12.276026 run osmo-stp_10.42.42.5(pid=17428): stdout: | (launched: 2022-12-14_00:09:10.559425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:12.418620 run osmo-stp_10.42.42.5(pid=17428): stderr: | [0;m[38;5;43m20221214000910864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000910864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000910865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000910865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000910866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000910866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000910866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:12.565206 run osmo-stp_10.42.42.5(pid=17428): stdout: | (launched: 2022-12-14_00:09:10.559425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:12.701849 run osmo-stp_10.42.42.5(pid=17428): stderr: | [0;m[38;5;43m20221214000910864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000910864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000910865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000910865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000910866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000910866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000910866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:12.862894 run patchelf(pid=17431): Terminating (SIGINT) 00:09:13.051435 run patchelf(pid=17431): Terminated: ok {rc=0} 00:09:13.185849 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17428): Process ended prematurely: osmo-stp_10.42.42.5(pid=17428) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17428)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 00:09:13.197690 tst iperf3m4.py:8: Test FAILED (12.3 sec) 00:09:13.228705 run osmo-hlr_10.42.42.2(pid=17425): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17425)] 00:09:13.283115 run osmo-hlr_10.42.42.2(pid=17425): stdout: | (launched: 2022-12-14_00:09:09.291320) 00:09:13.337493 run osmo-hlr_10.42.42.2(pid=17425): stderr: | [0;m[1;31m20221214000909603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000909603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000909603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000909603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000909603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000909603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000909626 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000909638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000909639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000909639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:13.393735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17216): Terminating (SIGTERM) 00:09:13.437320 run iperf3-srv_10.42.42.10(pid=17239): Terminating (SIGTERM) 00:09:13.485172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17325): Terminating (SIGTERM) 00:09:13.530626 run iperf3-srv_10.42.42.10(pid=17371): Terminating (SIGTERM) 00:09:13.577784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17416): Terminating (SIGTERM) 00:09:13.623125 run iperf3-srv_10.42.42.10(pid=17417): Terminating (SIGTERM) 00:09:13.670755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17418): Terminating (SIGTERM) 00:09:13.716281 run iperf3-srv_10.42.42.10(pid=17419): Terminating (SIGTERM) 00:09:13.764878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17424): Terminating (SIGTERM) 00:09:13.810048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17427): Terminating (SIGTERM) 00:09:13.856880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17430): Terminating (SIGTERM) 00:09:13.903561 --- ParallelTerminationStrategy: PID 17216 died... 00:09:13.925746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17216): Terminated: ok {rc=0} 00:09:13.977671 --- ParallelTerminationStrategy: PID 17239 died... 00:09:13.998976 run iperf3-srv_10.42.42.10(pid=17239): Terminated {rc=256} 00:09:14.048616 --- ParallelTerminationStrategy: PID 17325 died... 00:09:14.070400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17325): Terminated: ok {rc=0} 00:09:14.119280 --- ParallelTerminationStrategy: PID 17371 died... 00:09:14.141640 run iperf3-srv_10.42.42.10(pid=17371): Terminated {rc=256} 00:09:14.190870 --- ParallelTerminationStrategy: PID 17416 died... 00:09:14.212878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17416): Terminated: ok {rc=0} 00:09:14.262129 --- ParallelTerminationStrategy: PID 17417 died... 00:09:14.283724 run iperf3-srv_10.42.42.10(pid=17417): Terminated {rc=256} 00:09:14.332030 --- ParallelTerminationStrategy: PID 17418 died... 00:09:14.355325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17418): Terminated: ok {rc=0} 00:09:14.404044 --- ParallelTerminationStrategy: PID 17419 died... 00:09:14.425945 run iperf3-srv_10.42.42.10(pid=17419): Terminated {rc=256} 00:09:14.474823 --- ParallelTerminationStrategy: PID 17424 died... 00:09:14.496882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17424): Terminated: ok {rc=0} 00:09:14.545437 --- ParallelTerminationStrategy: PID 17427 died... 00:09:14.568206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17427): Terminated: ok {rc=0} 00:09:14.616741 --- ParallelTerminationStrategy: PID 17430 died... 00:09:14.638708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17430): Terminated: ok {rc=0} 00:09:14.732136 bus /gobi_4: Setting Powered False 00:09:15.847284 bus /gobi_4: Setting Powered False 00:09:17.019764 bus /gobi_1: Setting Powered False 00:09:18.140550 bus /gobi_1: Setting Powered False 00:09:19.257701 bus /gobi_0: Setting Powered False 00:09:20.359291 bus /gobi_0: Setting Powered False 00:09:21.475091 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 00:09:22.581575 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:22.594426 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:09:22.643504 tst ping.py: using LAC 37187 00:09:22.768104 tst ping.py: using RAC 212 00:09:22.887988 tst ping.py: using CellId 37187 00:09:23.006990 tst ping.py: using BVCI 37188 00:09:23.118995 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:23.131144 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:23.143137 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:23.155896 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:23.168229 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:23.180355 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:23.192714 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:23.205127 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:23.323859 tst ping.py:19: start network... 00:09:23.530370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:24.007577 run create_hlr_db(pid=17433): Launched 00:09:24.131888 bus /gobi_6: Setting Powered False 00:09:25.193541 run create_hlr_db(pid=17433): Terminated: ok {rc=0} 00:09:25.620728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17435): Launched 00:09:25.914013 run osmo-hlr_10.42.42.2(pid=17436): Launched 00:09:26.025511 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:26.536664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17438): Launched 00:09:26.830996 run osmo-stp_10.42.42.5(pid=17439): Launched 00:09:26.943276 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:27.453642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17441): Launched 00:09:27.565971 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:27.816068 run patchelf(pid=17442): Launched 00:09:27.979984 run osmo-stp_10.42.42.5(pid=17439): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17439)] 00:09:28.104720 run osmo-stp_10.42.42.5(pid=17439): stdout: | (launched: 2022-12-14_00:09:26.776467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:28.232282 run osmo-stp_10.42.42.5(pid=17439): stderr: | [0;m[38;5;43m20221214000926946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000926946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000926946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000926947 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000926947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000926947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000926947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:28.358900 run osmo-stp_10.42.42.5(pid=17439): stdout: | (launched: 2022-12-14_00:09:26.776467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:28.480330 run osmo-stp_10.42.42.5(pid=17439): stderr: | [0;m[38;5;43m20221214000926946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000926946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000926946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000926947 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000926947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000926947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000926947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:28.623514 run patchelf(pid=17442): Terminating (SIGINT) 00:09:28.789291 run patchelf(pid=17442): Terminated: ok {rc=0} 00:09:28.908198 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17439): Process ended prematurely: osmo-stp_10.42.42.5(pid=17439) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17439)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 00:09:28.917176 tst ping.py:22: Test FAILED (6.3 sec) 00:09:28.943694 run osmo-hlr_10.42.42.2(pid=17436): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17436)] 00:09:28.991325 run osmo-hlr_10.42.42.2(pid=17436): stdout: | (launched: 2022-12-14_00:09:25.859814) 00:09:29.040304 run osmo-hlr_10.42.42.2(pid=17436): stderr: | [0;m[1;31m20221214000926035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000926035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000926035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000926035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000926035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000926035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000926051 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000926061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000926061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000926061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:29.089798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17435): Terminating (SIGTERM) 00:09:29.129290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17438): Terminating (SIGTERM) 00:09:29.168635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17441): Terminating (SIGTERM) 00:09:29.208251 --- ParallelTerminationStrategy: PID 17435 died... 00:09:29.227273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17435): Terminated: ok {rc=0} 00:09:29.271025 --- ParallelTerminationStrategy: PID 17438 died... 00:09:29.289558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17438): Terminated: ok {rc=0} 00:09:29.332755 --- ParallelTerminationStrategy: PID 17441 died... 00:09:29.351610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17441): Terminated: ok {rc=0} 00:09:29.436302 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:09:30.523612 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:30.535418 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:09:30.584010 tst ping_idle_ping.py: using LAC 37188 00:09:30.702080 tst ping_idle_ping.py: using RAC 213 00:09:30.823962 tst ping_idle_ping.py: using CellId 37188 00:09:30.993987 tst ping_idle_ping.py: using BVCI 37189 00:09:31.138120 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:31.152915 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:31.168132 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:31.183611 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:31.197568 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:31.211466 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:31.225658 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:31.239873 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:31.381584 tst ping_idle_ping.py:24: start network... 00:09:31.633286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:32.148057 run create_hlr_db(pid=17443): Launched 00:09:32.305453 bus /gobi_6: Setting Powered False 00:09:33.364673 run create_hlr_db(pid=17443): Terminated: ok {rc=0} 00:09:33.778924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17445): Launched 00:09:34.075678 run osmo-hlr_10.42.42.2(pid=17446): Launched 00:09:34.188012 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:34.695548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17448): Launched 00:09:34.990901 run osmo-stp_10.42.42.5(pid=17449): Launched 00:09:35.102534 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:35.612840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17451): Launched 00:09:35.725214 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:35.974801 run patchelf(pid=17452): Launched 00:09:36.140191 run osmo-stp_10.42.42.5(pid=17449): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17449)] 00:09:36.265860 run osmo-stp_10.42.42.5(pid=17449): stdout: | (launched: 2022-12-14_00:09:34.936310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:36.392509 run osmo-stp_10.42.42.5(pid=17449): stderr: | [0;m[38;5;43m20221214000935106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000935106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000935106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000935107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000935107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000935107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000935107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:36.518745 run osmo-stp_10.42.42.5(pid=17449): stdout: | (launched: 2022-12-14_00:09:34.936310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:36.639614 run osmo-stp_10.42.42.5(pid=17449): stderr: | [0;m[38;5;43m20221214000935106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000935106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000935106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000935107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000935107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000935107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000935107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:36.782930 run patchelf(pid=17452): Terminating (SIGINT) 00:09:36.948743 run patchelf(pid=17452): Terminated: ok {rc=0} 00:09:37.068196 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17449): Process ended prematurely: osmo-stp_10.42.42.5(pid=17449) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17449)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 00:09:37.077211 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 00:09:37.103591 run osmo-hlr_10.42.42.2(pid=17446): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17446)] 00:09:37.150705 run osmo-hlr_10.42.42.2(pid=17446): stdout: | (launched: 2022-12-14_00:09:34.021406) 00:09:37.199658 run osmo-hlr_10.42.42.2(pid=17446): stderr: | [0;m[1;31m20221214000934195 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000934195 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000934195 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000934195 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000934195 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000934195 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000934208 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000934217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000934217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000934217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:37.248831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17445): Terminating (SIGTERM) 00:09:37.288197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17448): Terminating (SIGTERM) 00:09:37.327561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17451): Terminating (SIGTERM) 00:09:37.367172 --- ParallelTerminationStrategy: PID 17445 died... 00:09:37.386163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17445): Terminated: ok {rc=0} 00:09:37.429552 --- ParallelTerminationStrategy: PID 17448 died... 00:09:37.448000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17448): Terminated: ok {rc=0} 00:09:37.491114 --- ParallelTerminationStrategy: PID 17451 died... 00:09:37.509510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17451): Terminated: ok {rc=0} 00:09:37.591754 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:09:38.897674 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:09:38.904686 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:09:38.935052 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:09:38.976351 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:09:39.066296 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:09:39.096431 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:09:39.136545 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:09:39.735185 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:09:39.787682 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:39.799471 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:09:39.867987 tst cs_paging_gprs_active.py: using LAC 37189 00:09:39.988923 tst cs_paging_gprs_active.py: using RAC 214 00:09:40.106932 tst cs_paging_gprs_active.py: using CellId 37189 00:09:40.225206 tst cs_paging_gprs_active.py: using BVCI 37190 00:09:40.342888 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:40.354881 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:40.366851 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:40.378603 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:40.390754 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:40.402813 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:40.414992 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:40.427109 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:40.439432 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:09:40.557709 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:09:40.675062 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:09:40.878056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:41.181712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17456): Launched 00:09:41.444270 run iperf3-srv_10.42.42.10(pid=17457): Launched 00:09:41.556669 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:09:41.759110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:42.062045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17458): Launched 00:09:42.325122 run iperf3-srv_10.42.42.10(pid=17459): Launched 00:09:42.437489 tst cs_paging_gprs_active.py:38: start network... 00:09:42.639521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:43.107190 run create_hlr_db(pid=17460): Launched 00:09:43.231688 bus /gobi_6: Setting Powered False 00:09:44.293492 run create_hlr_db(pid=17460): Terminated: ok {rc=0} 00:09:44.733072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17462): Launched 00:09:45.055468 run osmo-hlr_10.42.42.2(pid=17463): Launched 00:09:45.179044 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:45.734932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17465): Launched 00:09:46.065689 run osmo-stp_10.42.42.5(pid=17466): Launched 00:09:46.228474 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:46.932377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17468): Launched 00:09:47.069883 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:47.348165 run patchelf(pid=17469): Launched 00:09:47.529419 run osmo-stp_10.42.42.5(pid=17466): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17466)] 00:09:47.665856 run osmo-stp_10.42.42.5(pid=17466): stdout: | (launched: 2022-12-14_00:09:46.002287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:47.803901 run osmo-stp_10.42.42.5(pid=17466): stderr: | [0;m[38;5;43m20221214000946300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000946300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000946300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000946301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000946302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000946302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000946302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:47.941964 run osmo-stp_10.42.42.5(pid=17466): stdout: | (launched: 2022-12-14_00:09:46.002287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:48.074720 run osmo-stp_10.42.42.5(pid=17466): stderr: | [0;m[38;5;43m20221214000946300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000946300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000946300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000946301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000946302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000946302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000946302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:48.231056 run patchelf(pid=17469): Terminating (SIGINT) 00:09:48.411859 run patchelf(pid=17469): Terminated: ok {rc=0} 00:09:48.542375 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17466): Process ended prematurely: osmo-stp_10.42.42.5(pid=17466) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17466)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:09:48.552652 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 00:09:48.581094 run osmo-hlr_10.42.42.2(pid=17463): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17463)] 00:09:48.631617 run osmo-hlr_10.42.42.2(pid=17463): stdout: | (launched: 2022-12-14_00:09:44.996075) 00:09:48.683435 run osmo-hlr_10.42.42.2(pid=17463): stderr: | [0;m[1;31m20221214000945196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000945196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000945196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000945196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000945196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000945196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000945211 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000945221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000945221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000945221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:48.735669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17456): Terminating (SIGTERM) 00:09:48.777563 run iperf3-srv_10.42.42.10(pid=17457): Terminating (SIGTERM) 00:09:48.819057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17458): Terminating (SIGTERM) 00:09:48.860823 run iperf3-srv_10.42.42.10(pid=17459): Terminating (SIGTERM) 00:09:48.902204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17462): Terminating (SIGTERM) 00:09:48.943871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17465): Terminating (SIGTERM) 00:09:48.985930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17468): Terminating (SIGTERM) 00:09:49.027868 --- ParallelTerminationStrategy: PID 17456 died... 00:09:49.047712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17456): Terminated: ok {rc=0} 00:09:49.093817 --- ParallelTerminationStrategy: PID 17457 died... 00:09:49.113467 run iperf3-srv_10.42.42.10(pid=17457): Terminated {rc=256} 00:09:49.159226 --- ParallelTerminationStrategy: PID 17458 died... 00:09:49.178919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17458): Terminated: ok {rc=0} 00:09:49.224586 --- ParallelTerminationStrategy: PID 17459 died... 00:09:49.244103 run iperf3-srv_10.42.42.10(pid=17459): Terminated {rc=256} 00:09:49.289621 --- ParallelTerminationStrategy: PID 17462 died... 00:09:49.309474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17462): Terminated: ok {rc=0} 00:09:49.355189 --- ParallelTerminationStrategy: PID 17465 died... 00:09:49.375052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17465): Terminated: ok {rc=0} 00:09:49.420635 --- ParallelTerminationStrategy: PID 17468 died... 00:09:49.440328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17468): Terminated: ok {rc=0} 00:09:49.527638 bus /gobi_0: Setting Powered False 00:09:50.625506 bus /gobi_0: Setting Powered False 00:09:51.740861 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:09:52.889823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:52.902347 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:09:52.973236 tst iperf3.py: using LAC 37190 00:09:53.099425 tst iperf3.py: using RAC 215 00:09:53.226236 tst iperf3.py: using CellId 37190 00:09:53.353438 tst iperf3.py: using BVCI 37191 00:09:53.469770 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:53.481435 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:53.492817 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:53.504723 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:53.516695 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:53.528371 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:53.540396 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:53.552221 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:53.564231 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:09:53.681151 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:09:53.884929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:54.188744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17470): Launched 00:09:54.453190 run iperf3-srv_10.42.42.10(pid=17471): Launched 00:09:54.566466 tst iperf3.py:8: start network... 00:09:54.768382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:55.234324 run create_hlr_db(pid=17472): Launched 00:09:55.358741 bus /gobi_6: Setting Powered False 00:09:56.419136 run create_hlr_db(pid=17472): Terminated: ok {rc=0} 00:09:56.858179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17474): Launched 00:09:57.165455 run osmo-hlr_10.42.42.2(pid=17475): Launched 00:09:57.279465 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:57.807552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17477): Launched 00:09:58.107883 run osmo-stp_10.42.42.5(pid=17478): Launched 00:09:58.222023 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:58.740720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17480): Launched 00:09:58.855287 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:59.110175 run patchelf(pid=17481): Launched 00:09:59.278628 run osmo-stp_10.42.42.5(pid=17478): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17478)] 00:09:59.405658 run osmo-stp_10.42.42.5(pid=17478): stdout: | (launched: 2022-12-14_00:09:58.052273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:59.534647 run osmo-stp_10.42.42.5(pid=17478): stderr: | [0;m[38;5;43m20221214000958224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000958224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000958225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000958225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000958225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000958226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000958226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:59.663665 run osmo-stp_10.42.42.5(pid=17478): stdout: | (launched: 2022-12-14_00:09:58.052273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:59.786612 run osmo-stp_10.42.42.5(pid=17478): stderr: | [0;m[38;5;43m20221214000958224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214000958224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214000958225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214000958225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214000958225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214000958226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214000958226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:59.932170 run patchelf(pid=17481): Terminating (SIGINT) 00:10:00.101362 run patchelf(pid=17481): Terminated: ok {rc=0} 00:10:00.223092 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17478): Process ended prematurely: osmo-stp_10.42.42.5(pid=17478) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17478)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 00:10:00.232644 tst iperf3.py:8: Test FAILED (7.4 sec) 00:10:00.259643 run osmo-hlr_10.42.42.2(pid=17475): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17475)] 00:10:00.307425 run osmo-hlr_10.42.42.2(pid=17475): stdout: | (launched: 2022-12-14_00:09:57.109758) 00:10:00.356481 run osmo-hlr_10.42.42.2(pid=17475): stderr: | [0;m[1;31m20221214000957285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214000957285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214000957285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214000957285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214000957285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214000957285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214000957297 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214000957306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214000957306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214000957306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:00.406503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17470): Terminating (SIGTERM) 00:10:00.446316 run iperf3-srv_10.42.42.10(pid=17471): Terminating (SIGTERM) 00:10:00.485570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17474): Terminating (SIGTERM) 00:10:00.524921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17477): Terminating (SIGTERM) 00:10:00.564160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17480): Terminating (SIGTERM) 00:10:00.603815 --- ParallelTerminationStrategy: PID 17470 died... 00:10:00.622751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17470): Terminated: ok {rc=0} 00:10:00.666259 --- ParallelTerminationStrategy: PID 17471 died... 00:10:00.684449 run iperf3-srv_10.42.42.10(pid=17471): Terminated {rc=256} 00:10:00.727904 --- ParallelTerminationStrategy: PID 17474 died... 00:10:00.746423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17474): Terminated: ok {rc=0} 00:10:00.789734 --- ParallelTerminationStrategy: PID 17477 died... 00:10:00.808069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17477): Terminated: ok {rc=0} 00:10:00.854646 --- ParallelTerminationStrategy: PID 17480 died... 00:10:00.876842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17480): Terminated: ok {rc=0} 00:10:00.987293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:10:02.146467 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:02.158823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:10:02.290516 tst iperf3m4.py: using LAC 37191 00:10:02.509771 tst iperf3m4.py: using RAC 216 00:10:02.637164 tst iperf3m4.py: using CellId 37191 00:10:02.764423 tst iperf3m4.py: using BVCI 37192 00:10:02.880685 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:02.892317 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:02.903798 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:02.915215 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:02.927422 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:02.939553 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:02.951909 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:02.964083 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:02.976406 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:03.096466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:03.219460 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:03.334998 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:03.455480 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:10:03.672201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:03.994724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17485): Launched 00:10:04.274619 run iperf3-srv_10.42.42.10(pid=17486): Launched 00:10:04.396654 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:10:04.614100 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:04.937265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17488): Launched 00:10:05.216456 run iperf3-srv_10.42.42.10(pid=17489): Launched 00:10:05.337234 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:10:05.554535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:05.878108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17490): Launched 00:10:06.159947 run iperf3-srv_10.42.42.10(pid=17491): Launched 00:10:06.280069 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:10:06.497020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:06.820504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17492): Launched 00:10:07.100720 run iperf3-srv_10.42.42.10(pid=17493): Launched 00:10:07.221084 tst iperf3m4.py:8: start network... 00:10:07.437977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:07.938006 run create_hlr_db(pid=17494): Launched 00:10:08.063500 bus /gobi_6: Setting Powered False 00:10:09.127745 run create_hlr_db(pid=17494): Terminated: ok {rc=0} 00:10:09.575052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17496): Launched 00:10:09.897839 run osmo-hlr_10.42.42.2(pid=17497): Launched 00:10:10.020757 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:10.576913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17499): Launched 00:10:10.898194 run osmo-stp_10.42.42.5(pid=17500): Launched 00:10:11.021285 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:11.575879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17502): Launched 00:10:11.700147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:11.971534 run patchelf(pid=17503): Launched 00:10:12.151175 run osmo-stp_10.42.42.5(pid=17500): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17500)] 00:10:12.286831 run osmo-stp_10.42.42.5(pid=17500): stdout: | (launched: 2022-12-14_00:10:10.838776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:12.424483 run osmo-stp_10.42.42.5(pid=17500): stderr: | [0;m[38;5;43m20221214001011030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001011030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001011030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001011031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001011031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001011031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001011031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:12.562891 run osmo-stp_10.42.42.5(pid=17500): stdout: | (launched: 2022-12-14_00:10:10.838776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:12.694374 run osmo-stp_10.42.42.5(pid=17500): stderr: | [0;m[38;5;43m20221214001011030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001011030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001011030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001011031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001011031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001011031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001011031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:12.850352 run patchelf(pid=17503): Terminating (SIGINT) 00:10:13.030688 run patchelf(pid=17503): Terminated: ok {rc=0} 00:10:13.160841 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17500): Process ended prematurely: osmo-stp_10.42.42.5(pid=17500) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17500)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:10:13.171175 tst iperf3m4.py:8: Test FAILED (11.1 sec) 00:10:13.199752 run osmo-hlr_10.42.42.2(pid=17497): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17497)] 00:10:13.250071 run osmo-hlr_10.42.42.2(pid=17497): stdout: | (launched: 2022-12-14_00:10:09.838737) 00:10:13.301822 run osmo-hlr_10.42.42.2(pid=17497): stderr: | [0;m[1;31m20221214001010040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001010040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001010040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001010040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001010040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001010040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001010052 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001010062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001010062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001010062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:13.354117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17485): Terminating (SIGTERM) 00:10:13.395810 run iperf3-srv_10.42.42.10(pid=17486): Terminating (SIGTERM) 00:10:13.437371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17488): Terminating (SIGTERM) 00:10:13.478864 run iperf3-srv_10.42.42.10(pid=17489): Terminating (SIGTERM) 00:10:13.520023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17490): Terminating (SIGTERM) 00:10:13.561454 run iperf3-srv_10.42.42.10(pid=17491): Terminating (SIGTERM) 00:10:13.602693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17492): Terminating (SIGTERM) 00:10:13.643997 run iperf3-srv_10.42.42.10(pid=17493): Terminating (SIGTERM) 00:10:13.685470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17496): Terminating (SIGTERM) 00:10:13.726996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17499): Terminating (SIGTERM) 00:10:13.768353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17502): Terminating (SIGTERM) 00:10:13.809921 --- ParallelTerminationStrategy: PID 17485 died... 00:10:13.830057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17485): Terminated: ok {rc=0} 00:10:13.876012 --- ParallelTerminationStrategy: PID 17486 died... 00:10:13.895619 run iperf3-srv_10.42.42.10(pid=17486): Terminated {rc=256} 00:10:13.941339 --- ParallelTerminationStrategy: PID 17488 died... 00:10:13.960901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17488): Terminated: ok {rc=0} 00:10:14.007203 --- ParallelTerminationStrategy: PID 17489 died... 00:10:14.026825 run iperf3-srv_10.42.42.10(pid=17489): Terminated {rc=256} 00:10:14.072491 --- ParallelTerminationStrategy: PID 17490 died... 00:10:14.092265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17490): Terminated: ok {rc=0} 00:10:14.137939 --- ParallelTerminationStrategy: PID 17491 died... 00:10:14.157552 run iperf3-srv_10.42.42.10(pid=17491): Terminated {rc=256} 00:10:14.203151 --- ParallelTerminationStrategy: PID 17492 died... 00:10:14.222821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17492): Terminated: ok {rc=0} 00:10:14.268657 --- ParallelTerminationStrategy: PID 17493 died... 00:10:14.288342 run iperf3-srv_10.42.42.10(pid=17493): Terminated {rc=256} 00:10:14.333978 --- ParallelTerminationStrategy: PID 17496 died... 00:10:14.353697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17496): Terminated: ok {rc=0} 00:10:14.399541 --- ParallelTerminationStrategy: PID 17499 died... 00:10:14.419315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17499): Terminated: ok {rc=0} 00:10:14.465351 --- ParallelTerminationStrategy: PID 17502 died... 00:10:14.485170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17502): Terminated: ok {rc=0} 00:10:14.572165 bus /gobi_4: Setting Powered False 00:10:15.672512 bus /gobi_4: Setting Powered False 00:10:16.793364 bus /gobi_1: Setting Powered False 00:10:17.901232 bus /gobi_1: Setting Powered False 00:10:19.016202 bus /gobi_0: Setting Powered False 00:10:20.115298 bus /gobi_0: Setting Powered False 00:10:21.231303 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:10:22.331047 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:22.342894 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:10:22.409356 tst ping.py: using LAC 37192 00:10:22.524928 tst ping.py: using RAC 217 00:10:22.649725 tst ping.py: using CellId 37192 00:10:22.768236 tst ping.py: using BVCI 37193 00:10:22.876466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:22.887668 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:22.898532 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:22.909470 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:22.920258 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:22.931143 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:22.942113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:22.953053 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:23.072501 tst ping.py:19: start network... 00:10:23.284199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:23.770783 run create_hlr_db(pid=17504): Launched 00:10:23.890650 bus /gobi_6: Setting Powered False 00:10:24.952680 run create_hlr_db(pid=17504): Terminated: ok {rc=0} 00:10:25.394295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17506): Launched 00:10:25.710535 run osmo-hlr_10.42.42.2(pid=17507): Launched 00:10:25.831912 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:26.375699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17509): Launched 00:10:26.690132 run osmo-stp_10.42.42.5(pid=17510): Launched 00:10:26.812456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:27.358262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17512): Launched 00:10:27.480006 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:27.746826 run patchelf(pid=17513): Launched 00:10:27.923361 run osmo-stp_10.42.42.5(pid=17510): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17510)] 00:10:28.057854 run osmo-stp_10.42.42.5(pid=17510): stdout: | (launched: 2022-12-14_00:10:26.632446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:28.193254 run osmo-stp_10.42.42.5(pid=17510): stderr: | [0;m[38;5;43m20221214001026822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001026822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001026822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001026823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001026823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001026823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001026823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:28.328884 run osmo-stp_10.42.42.5(pid=17510): stdout: | (launched: 2022-12-14_00:10:26.632446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:28.458358 run osmo-stp_10.42.42.5(pid=17510): stderr: | [0;m[38;5;43m20221214001026822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001026822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001026822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001026823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001026823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001026823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001026823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:28.611534 run patchelf(pid=17513): Terminating (SIGINT) 00:10:28.788767 run patchelf(pid=17513): Terminated: ok {rc=0} 00:10:28.916071 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17510): Process ended prematurely: osmo-stp_10.42.42.5(pid=17510) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17510)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 00:10:28.925879 tst ping.py:22: Test FAILED (6.6 sec) 00:10:28.953695 run osmo-hlr_10.42.42.2(pid=17507): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17507)] 00:10:29.004530 run osmo-hlr_10.42.42.2(pid=17507): stdout: | (launched: 2022-12-14_00:10:25.652904) 00:10:29.056531 run osmo-hlr_10.42.42.2(pid=17507): stderr: | [0;m[1;31m20221214001025850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001025850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001025850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001025850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001025850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001025850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001025862 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001025870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001025870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001025870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:29.109666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17506): Terminating (SIGTERM) 00:10:29.150741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17509): Terminating (SIGTERM) 00:10:29.192064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17512): Terminating (SIGTERM) 00:10:29.235173 --- ParallelTerminationStrategy: PID 17506 died... 00:10:29.255333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17506): Terminated: ok {rc=0} 00:10:29.301511 --- ParallelTerminationStrategy: PID 17509 died... 00:10:29.321368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17509): Terminated: ok {rc=0} 00:10:29.367327 --- ParallelTerminationStrategy: PID 17512 died... 00:10:29.387129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17512): Terminated: ok {rc=0} 00:10:29.474041 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:10:30.558910 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:30.571244 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:10:30.638431 tst ping_idle_ping.py: using LAC 37193 00:10:30.756376 tst ping_idle_ping.py: using RAC 218 00:10:30.879550 tst ping_idle_ping.py: using CellId 37193 00:10:31.011589 tst ping_idle_ping.py: using BVCI 37194 00:10:31.157150 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:31.172437 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:31.187509 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:31.201854 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:31.216427 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:31.230836 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:31.245321 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:31.259592 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:31.386478 tst ping_idle_ping.py:24: start network... 00:10:31.634759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:32.143860 run create_hlr_db(pid=17515): Launched 00:10:32.275939 bus /gobi_6: Setting Powered False 00:10:33.338315 run create_hlr_db(pid=17515): Terminated: ok {rc=0} 00:10:33.762981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17517): Launched 00:10:34.059527 run osmo-hlr_10.42.42.2(pid=17518): Launched 00:10:34.172539 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:34.702959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17520): Launched 00:10:35.001200 run osmo-stp_10.42.42.5(pid=17521): Launched 00:10:35.113291 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:35.625513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17523): Launched 00:10:35.738551 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:35.989663 run patchelf(pid=17524): Launched 00:10:36.154226 run osmo-stp_10.42.42.5(pid=17521): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17521)] 00:10:36.279781 run osmo-stp_10.42.42.5(pid=17521): stdout: | (launched: 2022-12-14_00:10:34.946293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:36.407314 run osmo-stp_10.42.42.5(pid=17521): stderr: | [0;m[38;5;43m20221214001035119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001035119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001035120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001035120 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001035120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001035120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001035121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:36.534355 run osmo-stp_10.42.42.5(pid=17521): stdout: | (launched: 2022-12-14_00:10:34.946293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:36.656218 run osmo-stp_10.42.42.5(pid=17521): stderr: | [0;m[38;5;43m20221214001035119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001035119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001035120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001035120 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001035120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001035120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001035121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:36.801094 run patchelf(pid=17524): Terminating (SIGINT) 00:10:36.967357 run patchelf(pid=17524): Terminated: ok {rc=0} 00:10:37.087146 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17521): Process ended prematurely: osmo-stp_10.42.42.5(pid=17521) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17521)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:10:37.095960 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 00:10:37.122537 run osmo-hlr_10.42.42.2(pid=17518): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17518)] 00:10:37.170166 run osmo-hlr_10.42.42.2(pid=17518): stdout: | (launched: 2022-12-14_00:10:34.004662) 00:10:37.218873 run osmo-hlr_10.42.42.2(pid=17518): stderr: | [0;m[1;31m20221214001034182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001034182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001034182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001034182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001034182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001034182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001034194 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001034203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001034203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001034203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:37.268924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17517): Terminating (SIGTERM) 00:10:37.308483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17520): Terminating (SIGTERM) 00:10:37.347595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17523): Terminating (SIGTERM) 00:10:37.387055 --- ParallelTerminationStrategy: PID 17517 died... 00:10:37.405982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17517): Terminated: ok {rc=0} 00:10:37.449917 --- ParallelTerminationStrategy: PID 17520 died... 00:10:37.468444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17520): Terminated: ok {rc=0} 00:10:37.511607 --- ParallelTerminationStrategy: PID 17523 died... 00:10:37.530183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17523): Terminated: ok {rc=0} 00:10:37.615129 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:10:38.917132 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:10:38.923024 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:10:38.951668 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 00:10:38.990022 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 00:10:39.076447 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:10:39.105555 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 00:10:39.143938 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 00:10:39.746909 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 00:10:39.801119 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:39.812685 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:10:39.881670 tst cs_paging_gprs_active.py: using LAC 37194 00:10:40.003816 tst cs_paging_gprs_active.py: using RAC 219 00:10:40.124143 tst cs_paging_gprs_active.py: using CellId 37194 00:10:40.244736 tst cs_paging_gprs_active.py: using BVCI 37195 00:10:40.355395 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:40.366618 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:40.377538 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:40.388363 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:40.399321 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:40.410280 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:40.421243 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:40.432008 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:40.442994 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:10:40.558350 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:10:40.680090 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:10:40.898596 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:41.223631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17529): Launched 00:10:41.503957 run iperf3-srv_10.42.42.10(pid=17530): Launched 00:10:41.624654 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:10:41.842074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:42.168036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17531): Launched 00:10:42.448900 run iperf3-srv_10.42.42.10(pid=17532): Launched 00:10:42.569428 tst cs_paging_gprs_active.py:38: start network... 00:10:42.787474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:43.287105 run create_hlr_db(pid=17533): Launched 00:10:43.409777 bus /gobi_6: Setting Powered False 00:10:44.473717 run create_hlr_db(pid=17533): Terminated: ok {rc=0} 00:10:44.906629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17535): Launched 00:10:45.209492 run osmo-hlr_10.42.42.2(pid=17536): Launched 00:10:45.324259 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:45.854594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17538): Launched 00:10:46.218280 run osmo-stp_10.42.42.5(pid=17539): Launched 00:10:46.450626 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:47.190189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17541): Launched 00:10:47.319034 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:47.583649 run patchelf(pid=17542): Launched 00:10:47.751617 run osmo-stp_10.42.42.5(pid=17539): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17539)] 00:10:47.879408 run osmo-stp_10.42.42.5(pid=17539): stdout: | (launched: 2022-12-14_00:10:46.149743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:48.008939 run osmo-stp_10.42.42.5(pid=17539): stderr: | [0;m[38;5;43m20221214001046488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001046488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001046490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001046490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001046494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001046494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001046494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:48.138568 run osmo-stp_10.42.42.5(pid=17539): stdout: | (launched: 2022-12-14_00:10:46.149743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:48.261920 run osmo-stp_10.42.42.5(pid=17539): stderr: | [0;m[38;5;43m20221214001046488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001046488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001046490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001046490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001046494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001046494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001046494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:48.408129 run patchelf(pid=17542): Terminating (SIGINT) 00:10:48.578379 run patchelf(pid=17542): Terminated: ok {rc=0} 00:10:48.700832 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17539): Process ended prematurely: osmo-stp_10.42.42.5(pid=17539) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17539)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 00:10:48.710496 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 00:10:48.737616 run osmo-hlr_10.42.42.2(pid=17536): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17536)] 00:10:48.785376 run osmo-hlr_10.42.42.2(pid=17536): stdout: | (launched: 2022-12-14_00:10:45.153637) 00:10:48.834468 run osmo-hlr_10.42.42.2(pid=17536): stderr: | [0;m[1;31m20221214001045332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001045332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001045332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001045332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001045332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001045332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001045348 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001045358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001045358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001045358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:48.883881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17529): Terminating (SIGTERM) 00:10:48.923248 run iperf3-srv_10.42.42.10(pid=17530): Terminating (SIGTERM) 00:10:48.962464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17531): Terminating (SIGTERM) 00:10:49.002246 run iperf3-srv_10.42.42.10(pid=17532): Terminating (SIGTERM) 00:10:49.041579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17535): Terminating (SIGTERM) 00:10:49.080771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17538): Terminating (SIGTERM) 00:10:49.120153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17541): Terminating (SIGTERM) 00:10:49.159585 --- ParallelTerminationStrategy: PID 17529 died... 00:10:49.178538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17529): Terminated: ok {rc=0} 00:10:49.221935 --- ParallelTerminationStrategy: PID 17530 died... 00:10:49.240109 run iperf3-srv_10.42.42.10(pid=17530): Terminated {rc=256} 00:10:49.283526 --- ParallelTerminationStrategy: PID 17531 died... 00:10:49.301924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17531): Terminated: ok {rc=0} 00:10:49.345072 --- ParallelTerminationStrategy: PID 17532 died... 00:10:49.363456 run iperf3-srv_10.42.42.10(pid=17532): Terminated {rc=256} 00:10:49.406692 --- ParallelTerminationStrategy: PID 17535 died... 00:10:49.425301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17535): Terminated: ok {rc=0} 00:10:49.468279 --- ParallelTerminationStrategy: PID 17538 died... 00:10:49.486744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17538): Terminated: ok {rc=0} 00:10:49.529937 --- ParallelTerminationStrategy: PID 17541 died... 00:10:49.548256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17541): Terminated: ok {rc=0} 00:10:49.633367 bus /gobi_0: Setting Powered False 00:10:50.733460 bus /gobi_0: Setting Powered False 00:10:51.845399 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 00:10:52.992578 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.005348 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:10:53.073339 tst iperf3.py: using LAC 37195 00:10:53.200287 tst iperf3.py: using RAC 220 00:10:53.325078 tst iperf3.py: using CellId 37195 00:10:53.450826 tst iperf3.py: using BVCI 37196 00:10:53.567468 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.579299 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.590737 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.602259 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.614089 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.625765 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.637596 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.649221 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.661086 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:10:53.779461 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:10:53.982705 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:54.286583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17544): Launched 00:10:54.551388 run iperf3-srv_10.42.42.10(pid=17545): Launched 00:10:54.664694 tst iperf3.py:8: start network... 00:10:54.867376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:55.334612 run create_hlr_db(pid=17546): Launched 00:10:55.457433 bus /gobi_6: Setting Powered False 00:10:56.517780 run create_hlr_db(pid=17546): Terminated: ok {rc=0} 00:10:56.957384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17548): Launched 00:10:57.280003 run osmo-hlr_10.42.42.2(pid=17549): Launched 00:10:57.402725 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:57.957608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17551): Launched 00:10:58.281916 run osmo-stp_10.42.42.5(pid=17552): Launched 00:10:58.404489 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:58.959474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17554): Launched 00:10:59.083644 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:59.355719 run patchelf(pid=17555): Launched 00:10:59.534268 run osmo-stp_10.42.42.5(pid=17552): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17552)] 00:10:59.670664 run osmo-stp_10.42.42.5(pid=17552): stdout: | (launched: 2022-12-14_00:10:58.222663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:59.808355 run osmo-stp_10.42.42.5(pid=17552): stderr: | [0;m[38;5;43m20221214001058412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001058413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001058413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001058413 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001058417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001058417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001058417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:59.946489 run osmo-stp_10.42.42.5(pid=17552): stdout: | (launched: 2022-12-14_00:10:58.222663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:00.079507 run osmo-stp_10.42.42.5(pid=17552): stderr: | [0;m[38;5;43m20221214001058412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001058413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001058413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001058413 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001058417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001058417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001058417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:00.236014 run patchelf(pid=17555): Terminating (SIGINT) 00:11:00.417348 run patchelf(pid=17555): Terminated: ok {rc=0} 00:11:00.547588 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17552): Process ended prematurely: osmo-stp_10.42.42.5(pid=17552) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17552)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 00:11:00.557927 tst iperf3.py:8: Test FAILED (7.6 sec) 00:11:00.586472 run osmo-hlr_10.42.42.2(pid=17549): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17549)] 00:11:00.637064 run osmo-hlr_10.42.42.2(pid=17549): stdout: | (launched: 2022-12-14_00:10:57.221220) 00:11:00.688847 run osmo-hlr_10.42.42.2(pid=17549): stderr: | [0;m[1;31m20221214001057419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001057419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001057419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001057419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001057419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001057419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001057431 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001057440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001057440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001057440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:00.740890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17544): Terminating (SIGTERM) 00:11:00.782717 run iperf3-srv_10.42.42.10(pid=17545): Terminating (SIGTERM) 00:11:00.824843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17548): Terminating (SIGTERM) 00:11:00.893182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17551): Terminating (SIGTERM) 00:11:00.940809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17554): Terminating (SIGTERM) 00:11:00.983949 --- ParallelTerminationStrategy: PID 17544 died... 00:11:01.004008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17544): Terminated: ok {rc=0} 00:11:01.052100 --- ParallelTerminationStrategy: PID 17545 died... 00:11:01.071983 run iperf3-srv_10.42.42.10(pid=17545): Terminated {rc=256} 00:11:01.117910 --- ParallelTerminationStrategy: PID 17548 died... 00:11:01.137431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17548): Terminated: ok {rc=0} 00:11:01.182441 --- ParallelTerminationStrategy: PID 17551 died... 00:11:01.202476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17551): Terminated: ok {rc=0} 00:11:01.248638 --- ParallelTerminationStrategy: PID 17554 died... 00:11:01.268623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17554): Terminated: ok {rc=0} 00:11:01.355389 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 00:11:02.499310 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:02.511120 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:11:02.580048 tst iperf3m4.py: using LAC 37196 00:11:02.703583 tst iperf3m4.py: using RAC 221 00:11:02.821956 tst iperf3m4.py: using CellId 37196 00:11:02.946244 tst iperf3m4.py: using BVCI 37197 00:11:03.064019 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:03.075907 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:03.087606 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:03.099254 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:03.111452 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:03.123632 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:03.135701 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:03.147453 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:03.159571 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:03.279985 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:03.399475 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:03.520595 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:03.643466 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:11:03.861175 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:11:04.184531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17556): Launched 00:11:04.464853 run iperf3-srv_10.42.42.10(pid=17557): Launched 00:11:04.585765 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:11:04.803629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:11:05.127938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17558): Launched 00:11:05.407279 run iperf3-srv_10.42.42.10(pid=17559): Launched 00:11:05.529787 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:11:05.747142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:11:06.071610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17560): Launched 00:11:06.354715 run iperf3-srv_10.42.42.10(pid=17561): Launched 00:11:06.477109 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:11:06.695084 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:11:07.019677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17562): Launched 00:11:07.300882 run iperf3-srv_10.42.42.10(pid=17563): Launched 00:11:07.421839 tst iperf3m4.py:8: start network... 00:11:07.638830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:08.139622 run create_hlr_db(pid=17564): Launched 00:11:08.263984 bus /gobi_6: Setting Powered False 00:11:09.327629 run create_hlr_db(pid=17564): Terminated: ok {rc=0} 00:11:09.760701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17566): Launched 00:11:10.064694 run osmo-hlr_10.42.42.2(pid=17567): Launched 00:11:10.182538 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:10.719916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17569): Launched 00:11:11.043957 run osmo-stp_10.42.42.5(pid=17570): Launched 00:11:11.167365 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:11.724072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17572): Launched 00:11:11.847032 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:12.120254 run patchelf(pid=17573): Launched 00:11:12.300624 run osmo-stp_10.42.42.5(pid=17570): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17570)] 00:11:12.437038 run osmo-stp_10.42.42.5(pid=17570): stdout: | (launched: 2022-12-14_00:11:10.984246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:12.575071 run osmo-stp_10.42.42.5(pid=17570): stderr: | [0;m[38;5;43m20221214001111180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001111180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001111180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001111181 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001111181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001111181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001111181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:12.713092 run osmo-stp_10.42.42.5(pid=17570): stdout: | (launched: 2022-12-14_00:11:10.984246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:12.844852 run osmo-stp_10.42.42.5(pid=17570): stderr: | [0;m[38;5;43m20221214001111180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001111180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001111180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001111181 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001111181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001111181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001111181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:13.001283 run patchelf(pid=17573): Terminating (SIGINT) 00:11:13.182473 run patchelf(pid=17573): Terminated: ok {rc=0} 00:11:13.312339 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17570): Process ended prematurely: osmo-stp_10.42.42.5(pid=17570) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17570)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 00:11:13.322775 tst iperf3m4.py:8: Test FAILED (10.9 sec) 00:11:13.351393 run osmo-hlr_10.42.42.2(pid=17567): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17567)] 00:11:13.401957 run osmo-hlr_10.42.42.2(pid=17567): stdout: | (launched: 2022-12-14_00:11:10.008649) 00:11:13.454121 run osmo-hlr_10.42.42.2(pid=17567): stderr: | [0;m[1;31m20221214001110187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001110187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001110187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001110187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001110187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001110188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001110200 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001110210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001110210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001110210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:13.506262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17556): Terminating (SIGTERM) 00:11:13.548178 run iperf3-srv_10.42.42.10(pid=17557): Terminating (SIGTERM) 00:11:13.590350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17558): Terminating (SIGTERM) 00:11:13.632071 run iperf3-srv_10.42.42.10(pid=17559): Terminating (SIGTERM) 00:11:13.673685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17560): Terminating (SIGTERM) 00:11:13.715290 run iperf3-srv_10.42.42.10(pid=17561): Terminating (SIGTERM) 00:11:13.756810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17562): Terminating (SIGTERM) 00:11:13.799016 run iperf3-srv_10.42.42.10(pid=17563): Terminating (SIGTERM) 00:11:13.840544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17566): Terminating (SIGTERM) 00:11:13.882253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17569): Terminating (SIGTERM) 00:11:13.923798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17572): Terminating (SIGTERM) 00:11:13.965960 --- ParallelTerminationStrategy: PID 17556 died... 00:11:13.986307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17556): Terminated: ok {rc=0} 00:11:14.033053 --- ParallelTerminationStrategy: PID 17557 died... 00:11:14.052484 run iperf3-srv_10.42.42.10(pid=17557): Terminated {rc=256} 00:11:14.098960 --- ParallelTerminationStrategy: PID 17558 died... 00:11:14.118738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17558): Terminated: ok {rc=0} 00:11:14.164890 --- ParallelTerminationStrategy: PID 17559 died... 00:11:14.185257 run iperf3-srv_10.42.42.10(pid=17559): Terminated {rc=256} 00:11:14.231324 --- ParallelTerminationStrategy: PID 17560 died... 00:11:14.251170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17560): Terminated: ok {rc=0} 00:11:14.297338 --- ParallelTerminationStrategy: PID 17561 died... 00:11:14.317426 run iperf3-srv_10.42.42.10(pid=17561): Terminated {rc=256} 00:11:14.363384 --- ParallelTerminationStrategy: PID 17562 died... 00:11:14.383401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17562): Terminated: ok {rc=0} 00:11:14.429738 --- ParallelTerminationStrategy: PID 17563 died... 00:11:14.449591 run iperf3-srv_10.42.42.10(pid=17563): Terminated {rc=256} 00:11:14.495682 --- ParallelTerminationStrategy: PID 17566 died... 00:11:14.515719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17566): Terminated: ok {rc=0} 00:11:14.562053 --- ParallelTerminationStrategy: PID 17569 died... 00:11:14.582180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17569): Terminated: ok {rc=0} 00:11:14.628444 --- ParallelTerminationStrategy: PID 17572 died... 00:11:14.648381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17572): Terminated: ok {rc=0} 00:11:14.737244 bus /gobi_4: Setting Powered False 00:11:15.842972 bus /gobi_4: Setting Powered False 00:11:16.978018 bus /gobi_1: Setting Powered False 00:11:18.090459 bus /gobi_1: Setting Powered False 00:11:19.204861 bus /gobi_0: Setting Powered False 00:11:20.305260 bus /gobi_0: Setting Powered False 00:11:21.422691 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 00:11:22.525411 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:22.537116 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:11:22.603925 tst ping.py: using LAC 37197 00:11:22.720180 tst ping.py: using RAC 222 00:11:22.840624 tst ping.py: using CellId 37197 00:11:22.954393 tst ping.py: using BVCI 37198 00:11:23.061788 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:23.073302 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:23.084182 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:23.095179 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:23.106180 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:23.117382 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:23.128338 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:23.139410 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:23.254597 tst ping.py:19: start network... 00:11:23.453317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:23.911145 run create_hlr_db(pid=17574): Launched 00:11:24.031779 bus /gobi_6: Setting Powered False 00:11:25.091297 run create_hlr_db(pid=17574): Terminated: ok {rc=0} 00:11:25.523373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17576): Launched 00:11:25.841305 run osmo-hlr_10.42.42.2(pid=17577): Launched 00:11:25.963303 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:26.508768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17579): Launched 00:11:26.826209 run osmo-stp_10.42.42.5(pid=17580): Launched 00:11:26.946646 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:27.496491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17582): Launched 00:11:27.615884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:27.881447 run patchelf(pid=17583): Launched 00:11:28.055892 run osmo-stp_10.42.42.5(pid=17580): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17580)] 00:11:28.188752 run osmo-stp_10.42.42.5(pid=17580): stdout: | (launched: 2022-12-14_00:11:26.767593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:28.323161 run osmo-stp_10.42.42.5(pid=17580): stderr: | [0;m[38;5;43m20221214001126961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001126961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001126961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001126961 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001126962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001126962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001126962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:28.457852 run osmo-stp_10.42.42.5(pid=17580): stdout: | (launched: 2022-12-14_00:11:26.767593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:28.586390 run osmo-stp_10.42.42.5(pid=17580): stderr: | [0;m[38;5;43m20221214001126961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001126961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001126961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001126961 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001126962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001126962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001126962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:28.738971 run patchelf(pid=17583): Terminating (SIGINT) 00:11:28.914623 run patchelf(pid=17583): Terminated: ok {rc=0} 00:11:29.041479 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17580): Process ended prematurely: osmo-stp_10.42.42.5(pid=17580) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17580)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 00:11:29.051147 tst ping.py:22: Test FAILED (6.5 sec) 00:11:29.079377 run osmo-hlr_10.42.42.2(pid=17577): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17577)] 00:11:29.130556 run osmo-hlr_10.42.42.2(pid=17577): stdout: | (launched: 2022-12-14_00:11:25.783261) 00:11:29.182661 run osmo-hlr_10.42.42.2(pid=17577): stderr: | [0;m[1;31m20221214001125980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001125980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001125981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001125981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001125981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001125981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001125994 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001126002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001126002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001126002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:29.234975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17576): Terminating (SIGTERM) 00:11:29.276618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17579): Terminating (SIGTERM) 00:11:29.318463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17582): Terminating (SIGTERM) 00:11:29.360467 --- ParallelTerminationStrategy: PID 17576 died... 00:11:29.380839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17576): Terminated: ok {rc=0} 00:11:29.427087 --- ParallelTerminationStrategy: PID 17579 died... 00:11:29.446891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17579): Terminated: ok {rc=0} 00:11:29.492731 --- ParallelTerminationStrategy: PID 17582 died... 00:11:29.512360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17582): Terminated: ok {rc=0} 00:11:29.599284 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 00:11:30.686161 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:30.697995 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:11:30.766059 tst ping_idle_ping.py: using LAC 37198 00:11:30.894636 tst ping_idle_ping.py: using RAC 223 00:11:31.038592 tst ping_idle_ping.py: using CellId 37198 00:11:31.155228 tst ping_idle_ping.py: using BVCI 37199 00:11:31.303167 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:31.315977 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:31.328527 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:31.341125 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:31.354798 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:31.368494 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:31.382201 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:31.395600 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:31.520760 tst ping_idle_ping.py:24: start network... 00:11:31.738827 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:32.245641 run create_hlr_db(pid=17584): Launched 00:11:32.370757 bus /gobi_6: Setting Powered False 00:11:33.429650 run create_hlr_db(pid=17584): Terminated: ok {rc=0} 00:11:33.866247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17586): Launched 00:11:34.181810 run osmo-hlr_10.42.42.2(pid=17587): Launched 00:11:34.302316 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:34.846332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17589): Launched 00:11:35.161394 run osmo-stp_10.42.42.5(pid=17590): Launched 00:11:35.282140 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:35.826229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17592): Launched 00:11:35.946613 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:36.214284 run patchelf(pid=17593): Launched 00:11:36.378578 run osmo-stp_10.42.42.5(pid=17590): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17590)] 00:11:36.503723 run osmo-stp_10.42.42.5(pid=17590): stdout: | (launched: 2022-12-14_00:11:35.103069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:36.630615 run osmo-stp_10.42.42.5(pid=17590): stderr: | [0;m[38;5;43m20221214001135295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001135295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001135295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001135296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001135296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001135296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001135296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:36.757683 run osmo-stp_10.42.42.5(pid=17590): stdout: | (launched: 2022-12-14_00:11:35.103069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:36.879019 run osmo-stp_10.42.42.5(pid=17590): stderr: | [0;m[38;5;43m20221214001135295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001135295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001135295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001135296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001135296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001135296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001135296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:37.022401 run patchelf(pid=17593): Terminating (SIGINT) 00:11:37.188344 run patchelf(pid=17593): Terminated: ok {rc=0} 00:11:37.307433 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17590): Process ended prematurely: osmo-stp_10.42.42.5(pid=17590) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17590)] [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 00:11:37.316327 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:11:37.343153 run osmo-hlr_10.42.42.2(pid=17587): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17587)] 00:11:37.391304 run osmo-hlr_10.42.42.2(pid=17587): stdout: | (launched: 2022-12-14_00:11:34.123590) 00:11:37.440725 run osmo-hlr_10.42.42.2(pid=17587): stderr: | [0;m[1;31m20221214001134323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001134323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001134323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001134323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001134323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001134323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001134336 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001134345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001134345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001134345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:37.490609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17586): Terminating (SIGTERM) 00:11:37.530609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17589): Terminating (SIGTERM) 00:11:37.570525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17592): Terminating (SIGTERM) 00:11:37.610806 --- ParallelTerminationStrategy: PID 17586 died... 00:11:37.629988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17586): Terminated: ok {rc=0} 00:11:37.683766 --- ParallelTerminationStrategy: PID 17589 died... 00:11:37.702291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17589): Terminated: ok {rc=0} 00:11:37.745637 --- ParallelTerminationStrategy: PID 17592 died... 00:11:37.764066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17592): Terminated: ok {rc=0} 00:11:37.846607 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:11:39.160858 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:11:39.167901 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:11:39.197664 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:11:39.233858 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:11:39.287191 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:11:39.317116 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:11:39.352616 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:11:39.914957 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:11:39.920575 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:39.932676 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:11:40.002535 tst switch_tch_pdch.py: using LAC 37199 00:11:40.130279 tst switch_tch_pdch.py: using RAC 224 00:11:40.254846 tst switch_tch_pdch.py: using CellId 37199 00:11:40.377753 tst switch_tch_pdch.py: using BVCI 37200 00:11:40.490929 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:40.502934 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:40.514928 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:40.526817 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:40.539098 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:40.551311 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:40.563791 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:40.576125 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:11:40.693244 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:11:40.811952 tst switch_tch_pdch.py:51: start network... 00:11:41.023132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:41.507780 run create_hlr_db(pid=17597): Launched 00:11:41.627136 bus /gobi_6: Setting Powered False 00:11:42.689199 run create_hlr_db(pid=17597): Terminated: ok {rc=0} 00:11:43.110170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17599): Launched 00:11:43.403701 run osmo-hlr_10.42.42.2(pid=17600): Launched 00:11:43.514453 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:44.020331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17602): Launched 00:11:44.311356 run osmo-stp_10.42.42.5(pid=17603): Launched 00:11:44.422588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:44.926765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17605): Launched 00:11:45.038048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:45.285610 run patchelf(pid=17606): Launched 00:11:45.447574 run osmo-stp_10.42.42.5(pid=17603): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17603)] 00:11:45.571219 run osmo-stp_10.42.42.5(pid=17603): stdout: | (launched: 2022-12-14_00:11:44.257705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:45.696631 run osmo-stp_10.42.42.5(pid=17603): stderr: | [0;m[38;5;43m20221214001144429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001144429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001144429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001144429 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001144430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001144430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001144430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:45.821642 run osmo-stp_10.42.42.5(pid=17603): stdout: | (launched: 2022-12-14_00:11:44.257705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:45.960855 run osmo-stp_10.42.42.5(pid=17603): stderr: | [0;m[38;5;43m20221214001144429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001144429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001144429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001144429 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001144430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001144430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001144430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:46.122041 run patchelf(pid=17606): Terminating (SIGINT) 00:11:46.304739 run patchelf(pid=17606): Terminated: ok {rc=0} 00:11:46.437506 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17603): Process ended prematurely: osmo-stp_10.42.42.5(pid=17603) [trial-2396↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17603)] [trial-2396↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:11:46.448520 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 00:11:46.477877 run osmo-hlr_10.42.42.2(pid=17600): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17600)] 00:11:46.533116 run osmo-hlr_10.42.42.2(pid=17600): stdout: | (launched: 2022-12-14_00:11:43.349728) 00:11:46.586905 run osmo-hlr_10.42.42.2(pid=17600): stderr: | [0;m[1;31m20221214001143523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001143523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001143523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001143523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001143523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001143523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001143536 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001143545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001143545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001143545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:46.644881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17599): Terminating (SIGTERM) 00:11:46.689155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17602): Terminating (SIGTERM) 00:11:46.735322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17605): Terminating (SIGTERM) 00:11:46.781637 --- ParallelTerminationStrategy: PID 17599 died... 00:11:46.803720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17599): Terminated: ok {rc=0} 00:11:46.854253 --- ParallelTerminationStrategy: PID 17602 died... 00:11:46.875455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17602): Terminated: ok {rc=0} 00:11:46.923953 --- ParallelTerminationStrategy: PID 17605 died... 00:11:46.945888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17605): Terminated: ok {rc=0} 00:11:47.043394 bus /gobi_0: Setting Powered False 00:11:48.144265 bus /gobi_0: Setting Powered False 00:11:49.258756 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 00:11:50.515754 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:11:50.522749 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 00:11:50.551725 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 00:11:50.586106 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 00:11:50.638323 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 00:11:50.668271 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 00:11:50.704767 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 00:11:51.263442 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 00:11:51.269421 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:51.281593 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 00:11:51.346649 tst switch_tch_pdch.py: using LAC 37200 00:11:51.460747 tst switch_tch_pdch.py: using RAC 225 00:11:51.574788 tst switch_tch_pdch.py: using CellId 37200 00:11:51.687692 tst switch_tch_pdch.py: using BVCI 37201 00:11:51.793466 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:51.804461 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:51.815429 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:51.826805 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:51.837588 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:51.848417 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:51.859876 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:51.870728 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:11:51.990153 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:11:52.105563 tst switch_tch_pdch.py:51: start network... 00:11:52.301236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:52.726927 run create_hlr_db(pid=17610): Launched 00:11:52.846511 bus /gobi_6: Setting Powered False 00:11:53.904862 run create_hlr_db(pid=17610): Terminated: ok {rc=0} 00:11:54.307442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17612): Launched 00:11:54.619811 run osmo-hlr_10.42.42.2(pid=17613): Launched 00:11:54.732075 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:55.224809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17615): Launched 00:11:55.516859 run osmo-stp_10.42.42.5(pid=17616): Launched 00:11:55.628041 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:56.107942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17618): Launched 00:11:56.219268 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:56.466845 run patchelf(pid=17619): Launched 00:11:56.629515 run osmo-stp_10.42.42.5(pid=17616): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17616)] 00:11:56.753345 run osmo-stp_10.42.42.5(pid=17616): stdout: | (launched: 2022-12-14_00:11:55.463265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:56.879430 run osmo-stp_10.42.42.5(pid=17616): stderr: | [0;m[38;5;43m20221214001155633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001155633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001155633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001155634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001155634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001155634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001155634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:57.005488 run osmo-stp_10.42.42.5(pid=17616): stdout: | (launched: 2022-12-14_00:11:55.463265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:57.125795 run osmo-stp_10.42.42.5(pid=17616): stderr: | [0;m[38;5;43m20221214001155633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001155633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001155633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001155634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001155634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001155634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001155634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:57.268128 run patchelf(pid=17619): Terminating (SIGINT) 00:11:57.433368 run patchelf(pid=17619): Terminated: ok {rc=0} 00:11:57.551687 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17616): Process ended prematurely: osmo-stp_10.42.42.5(pid=17616) [trial-2396↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17616)] [trial-2396↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 00:11:57.560407 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 00:11:57.586836 run osmo-hlr_10.42.42.2(pid=17613): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17613)] 00:11:57.633856 run osmo-hlr_10.42.42.2(pid=17613): stdout: | (launched: 2022-12-14_00:11:54.562758) 00:11:57.682580 run osmo-hlr_10.42.42.2(pid=17613): stderr: | [0;m[1;31m20221214001154739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001154739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001154739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001154739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001154739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001154739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001154751 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001154760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001154760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001154761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:57.731602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17612): Terminating (SIGTERM) 00:11:57.771040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17615): Terminating (SIGTERM) 00:11:57.810513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17618): Terminating (SIGTERM) 00:11:57.850109 --- ParallelTerminationStrategy: PID 17612 died... 00:11:57.869095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17612): Terminated: ok {rc=0} 00:11:57.912596 --- ParallelTerminationStrategy: PID 17615 died... 00:11:57.931033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17615): Terminated: ok {rc=0} 00:11:57.974427 --- ParallelTerminationStrategy: PID 17618 died... 00:11:57.992699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17618): Terminated: ok {rc=0} 00:11:58.075804 bus /gobi_0: Setting Powered False 00:11:59.170620 bus /gobi_0: Setting Powered False 00:12:00.285287 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_sms:nanobts --------------------------------------------------------------------- 00:12:01.538791 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:01.543161 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 00:12:01.569662 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 00:12:01.583082 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 00:12:01.652173 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 00:12:01.684640 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 00:12:01.694305 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 00:12:02.233760 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 00:12:02.239799 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 00:12:02.250806 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 00:12:02.287520 tst mo_mt_sms.py: using LAC 37201 00:12:02.402457 tst mo_mt_sms.py: using RAC 226 00:12:02.516007 tst mo_mt_sms.py: using CellId 37201 00:12:02.629439 tst mo_mt_sms.py: using BVCI 37202 00:12:02.735206 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 00:12:02.851953 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 00:12:02.967640 tst mo_mt_sms.py:9: start nitb and bts... 00:12:03.164364 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:12:03.763601 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17623): Launched 00:12:04.055482 run osmo-nitb_10.42.42.2(pid=17624): Launched 00:12:04.217924 run osmo-nitb_10.42.42.2(pid=17624): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17624)] 00:12:04.350578 run osmo-nitb_10.42.42.2(pid=17624): stdout: | (launched: 2022-12-14_00:12:04.002073) 00:12:04.484376 run osmo-nitb_10.42.42.2(pid=17624): stderr: | (launched: 2022-12-14_00:12:04.045496) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:12:04.618257 run osmo-nitb_10.42.42.2(pid=17624): stdout: | (launched: 2022-12-14_00:12:04.002073) 00:12:04.746099 run osmo-nitb_10.42.42.2(pid=17624): stderr: | (launched: 2022-12-14_00:12:04.045496) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17624): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17624) [trial-2396↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17624)] 00:12:05.166116 tst osmo-nitb_10.42.42.2(pid=17624): stdout: | (launched: 2022-12-14_00:12:04.002073) 00:12:05.284459 tst osmo-nitb_10.42.42.2(pid=17624): stderr: | (launched: 2022-12-14_00:12:04.045496) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:12:05.424261 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=17624): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17624) [trial-2396↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17624)] [trial-2396↪nitb_sms:nanobts↪mo_mt_sms.py:11] 00:12:05.432719 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 00:12:05.439297 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17623): Terminating (SIGTERM) 00:12:05.647277 --- ParallelTerminationStrategy: PID 17623 died... 00:12:05.667958 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17623): Terminated: ok {rc=0} 00:12:05.753105 bus /sierra_3: Setting Powered False 00:12:06.852296 bus /sierra_3: Setting Powered False 00:12:07.968501 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 sms:nanobts+band-1900 --------------------------------------------------------------------- 00:12:09.157523 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:09.162971 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:12:09.186410 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 00:12:09.212925 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 00:12:09.265274 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:12:09.290130 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 00:12:09.318412 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 00:12:09.861936 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 00:12:09.867952 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:09.880034 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:12:09.920037 tst mo_mt_sms.py: using LAC 37202 00:12:10.045704 tst mo_mt_sms.py: using RAC 227 00:12:10.169683 tst mo_mt_sms.py: using CellId 37202 00:12:10.285574 tst mo_mt_sms.py: using BVCI 37203 00:12:10.391004 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:10.401776 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:10.412271 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:10.422788 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:10.433238 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:10.444142 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 00:12:10.563101 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 00:12:10.678409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:11.132391 run create_hlr_db(pid=17628): Launched 00:12:11.251560 bus /sierra_2: Setting Powered False 00:12:12.310266 run create_hlr_db(pid=17628): Terminated: ok {rc=0} 00:12:12.738611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17630): Launched 00:12:13.050520 run osmo-hlr_10.42.42.2(pid=17631): Launched 00:12:13.169989 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:13.707503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17633): Launched 00:12:14.020200 run osmo-stp_10.42.42.5(pid=17634): Launched 00:12:14.140040 run osmo-msc_10.42.42.6: Starting osmo-msc 00:12:14.705342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17636): Launched 00:12:15.018395 run osmo-msc_10.42.42.6(pid=17637): Launched 00:12:15.193712 run osmo-stp_10.42.42.5(pid=17634): ERR: Terminated: ERROR {rc=1} [trial-2396↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17634)] 00:12:15.328258 run osmo-stp_10.42.42.5(pid=17634): stdout: | (launched: 2022-12-14_00:12:13.962349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:15.463355 run osmo-stp_10.42.42.5(pid=17634): stderr: | [0;m[38;5;43m20221214001214155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001214155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001214155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001214155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001214156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001214156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001214156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:15.595684 run osmo-stp_10.42.42.5(pid=17634): stdout: | (launched: 2022-12-14_00:12:13.962349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:15.720090 run osmo-stp_10.42.42.5(pid=17634): stderr: | [0;m[38;5;43m20221214001214155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001214155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001214155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001214155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001214156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001214156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001214156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:15.897744 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=17634): Process ended prematurely: osmo-stp_10.42.42.5(pid=17634) [trial-2396↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17634)] [trial-2396↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 00:12:15.907513 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 00:12:15.937434 run osmo-hlr_10.42.42.2(pid=17631): ERR: Terminated: ERROR {rc=237} [trial-2396↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17631)] 00:12:15.999571 run osmo-hlr_10.42.42.2(pid=17631): stdout: | (launched: 2022-12-14_00:12:12.993723) 00:12:16.054218 run osmo-hlr_10.42.42.2(pid=17631): stderr: | [0;m[1;31m20221214001213191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001213191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001213191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001213191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001213191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001213191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001213204 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001213212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001213212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001213212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:16.129319 run osmo-msc_10.42.42.6(pid=17637): ERR: Terminated: ERROR {rc=2} [trial-2396↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17637)] 00:12:16.180928 run osmo-msc_10.42.42.6(pid=17637): stdout: | (launched: 2022-12-14_00:12:14.961426) 00:12:16.234910 run osmo-msc_10.42.42.6(pid=17637): stderr: | [0;m[38;5;43m20221214001215279 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001215279 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5d82622c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001215279 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001215280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001215280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001215280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001215282 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001215282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001215282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001215282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:12:16.290565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17630): Terminating (SIGTERM) 00:12:16.333825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17633): Terminating (SIGTERM) 00:12:16.378009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17636): Terminating (SIGTERM) 00:12:16.423572 --- ParallelTerminationStrategy: PID 17630 died... 00:12:16.445595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17630): Terminated: ok {rc=0} 00:12:16.494048 --- ParallelTerminationStrategy: PID 17633 died... 00:12:16.515508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17633): Terminated: ok {rc=0} 00:12:16.564075 --- ParallelTerminationStrategy: PID 17636 died... 00:12:16.586477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17636): Terminated: ok {rc=0} 00:12:16.681185 bus /sierra_3: Setting Powered False 00:12:17.788867 bus /sierra_3: Setting Powered False 00:12:18.903518 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 00:12:20.129802 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:20.134352 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:12:20.157665 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 00:12:20.164329 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 00:12:20.197740 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:12:20.221643 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 00:12:20.228309 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 00:12:20.750615 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2396 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 00:12:20.755670 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 00:12:20.766570 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:12:20.803063 tst assert_extension.py: using LAC 37203 00:12:20.916471 tst assert_extension.py: using RAC 228 00:12:21.037398 tst assert_extension.py: using CellId 37203 00:12:21.159274 tst assert_extension.py: using BVCI 37204 00:12:21.273920 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 00:12:21.388335 tst assert_extension.py:10: start nitb and bts... 00:12:21.585738 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:12:22.182959 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17642): Launched 00:12:22.474657 run osmo-nitb_10.42.42.2(pid=17643): Launched 00:12:22.635923 run osmo-nitb_10.42.42.2(pid=17643): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17643)] 00:12:22.767102 run osmo-nitb_10.42.42.2(pid=17643): stdout: | (launched: 2022-12-14_00:12:22.420922) 00:12:22.899662 run osmo-nitb_10.42.42.2(pid=17643): stderr: | (launched: 2022-12-14_00:12:22.464339) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:12:23.032604 run osmo-nitb_10.42.42.2(pid=17643): stdout: | (launched: 2022-12-14_00:12:22.420922) 00:12:23.160320 run osmo-nitb_10.42.42.2(pid=17643): stderr: | (launched: 2022-12-14_00:12:22.464339) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17643): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17643) [trial-2396↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17643)] 00:12:23.584465 tst osmo-nitb_10.42.42.2(pid=17643): stdout: | (launched: 2022-12-14_00:12:22.420922) 00:12:23.701768 tst osmo-nitb_10.42.42.2(pid=17643): stderr: | (launched: 2022-12-14_00:12:22.464339) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:12:23.840129 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=17643): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17643) [trial-2396↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17643)] [trial-2396↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 00:12:23.848540 tst assert_extension.py:12: Test FAILED (3.1 sec) 00:12:23.855162 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17642): Terminating (SIGTERM) 00:12:24.063453 --- ParallelTerminationStrategy: PID 17642 died... 00:12:24.083474 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17642): Terminated: ok {rc=0} 00:12:24.169850 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 ussd:nanobts+band-1900 --------------------------------------------------------------------- 00:12:25.338321 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:25.343539 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:12:25.367697 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 00:12:25.395247 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 00:12:25.431228 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:12:25.454787 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 00:12:25.481116 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 00:12:26.012671 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2396 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 00:12:26.018249 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:26.029471 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:12:26.067809 tst assert_extension.py: using LAC 37204 00:12:26.182260 tst assert_extension.py: using RAC 229 00:12:26.297094 tst assert_extension.py: using CellId 37204 00:12:26.411936 tst assert_extension.py: using BVCI 37205 00:12:26.519123 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:26.529835 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:26.540323 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:26.550749 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:26.561200 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:26.571671 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 00:12:26.688837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:27.173130 run create_hlr_db(pid=17648): Launched 00:12:27.292133 bus /sierra_2: Setting Powered False 00:12:28.350792 run create_hlr_db(pid=17648): Terminated: ok {rc=0} 00:12:28.768881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17650): Launched 00:12:29.062917 run osmo-hlr_10.42.42.2(pid=17651): Launched 00:12:29.174044 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:29.679052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17653): Launched 00:12:29.971173 run osmo-stp_10.42.42.5(pid=17654): Launched 00:12:30.082389 run osmo-msc_10.42.42.6: Starting osmo-msc 00:12:30.621591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17656): Launched 00:12:30.953781 run osmo-msc_10.42.42.6(pid=17657): Launched 00:12:31.348046 run osmo-stp_10.42.42.5(pid=17654): ERR: Terminated: ERROR {rc=1} [trial-2396↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17654)] 00:12:31.576430 run osmo-stp_10.42.42.5(pid=17654): stdout: | (launched: 2022-12-14_00:12:29.917529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:31.744576 run osmo-stp_10.42.42.5(pid=17654): stderr: | [0;m[38;5;43m20221214001230087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001230087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001230087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001230088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001230088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001230088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001230088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:31.874216 run osmo-stp_10.42.42.5(pid=17654): stdout: | (launched: 2022-12-14_00:12:29.917529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:31.996680 run osmo-stp_10.42.42.5(pid=17654): stderr: | [0;m[38;5;43m20221214001230087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001230087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001230087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001230088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001230088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001230088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001230088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:32.140158 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=17654): Process ended prematurely: osmo-stp_10.42.42.5(pid=17654) [trial-2396↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17654)] [trial-2396↪ussd:nanobts+band-1900↪assert_extension.py:17] 00:12:32.148918 tst assert_extension.py:17: Test FAILED (6.1 sec) 00:12:32.176500 run osmo-hlr_10.42.42.2(pid=17651): ERR: Terminated: ERROR {rc=237} [trial-2396↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17651)] 00:12:32.225244 run osmo-hlr_10.42.42.2(pid=17651): stdout: | (launched: 2022-12-14_00:12:29.009186) 00:12:32.275763 run osmo-hlr_10.42.42.2(pid=17651): stderr: | [0;m[1;31m20221214001229186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001229186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001229187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001229187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001229187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001229187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001229199 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001229207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001229207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001229207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:32.345524 run osmo-msc_10.42.42.6(pid=17657): ERR: Terminated: ERROR {rc=2} [trial-2396↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17657)] 00:12:32.393887 run osmo-msc_10.42.42.6(pid=17657): stdout: | (launched: 2022-12-14_00:12:30.869464) 00:12:32.443635 run osmo-msc_10.42.42.6(pid=17657): stderr: | [0;m[38;5;43m20221214001231457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001231459 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe478a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001231460 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001231461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001231462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001231463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001231465 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001231466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001231466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001231466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:12:32.493337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17650): Terminating (SIGTERM) 00:12:32.532508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17653): Terminating (SIGTERM) 00:12:32.571857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17656): Terminating (SIGTERM) 00:12:32.611394 --- ParallelTerminationStrategy: PID 17650 died... 00:12:32.630478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17650): Terminated: ok {rc=0} 00:12:32.674511 --- ParallelTerminationStrategy: PID 17653 died... 00:12:32.693155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17653): Terminated: ok {rc=0} 00:12:32.737014 --- ParallelTerminationStrategy: PID 17656 died... 00:12:32.755955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17656): Terminated: ok {rc=0} 00:12:32.841310 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:12:34.046931 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:34.055379 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:12:34.079881 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:12:34.108118 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:12:34.160709 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:12:34.185401 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:12:34.213430 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:12:34.766071 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:12:34.818604 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:34.830353 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:12:34.891959 tst mo_mt_call.py: using LAC 37205 00:12:35.022851 tst mo_mt_call.py: using RAC 230 00:12:35.147390 tst mo_mt_call.py: using CellId 37205 00:12:35.269920 tst mo_mt_call.py: using BVCI 37206 00:12:35.386902 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:35.398653 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:35.410108 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:35.421616 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:35.433840 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:35.445692 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:12:35.562225 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:12:35.680522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:36.173212 run create_hlr_db(pid=17662): Launched 00:12:36.294729 bus /sierra_2: Setting Powered False 00:12:37.358602 run create_hlr_db(pid=17662): Terminated: ok {rc=0} 00:12:37.785883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17664): Launched 00:12:38.083644 run osmo-hlr_10.42.42.2(pid=17665): Launched 00:12:38.197111 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:38.713449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17667): Launched 00:12:39.010500 run osmo-stp_10.42.42.5(pid=17668): Launched 00:12:39.123943 run osmo-msc_10.42.42.6: Starting osmo-msc 00:12:39.661562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17670): Launched 00:12:39.959336 run osmo-msc_10.42.42.6(pid=17671): Launched 00:12:40.125582 run osmo-stp_10.42.42.5(pid=17668): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17668)] 00:12:40.251055 run osmo-stp_10.42.42.5(pid=17668): stdout: | (launched: 2022-12-14_00:12:38.955844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:40.376914 run osmo-stp_10.42.42.5(pid=17668): stderr: | [0;m[38;5;43m20221214001239126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001239126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001239126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001239127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001239127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001239127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001239127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:40.501073 run osmo-stp_10.42.42.5(pid=17668): stdout: | (launched: 2022-12-14_00:12:38.955844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:40.619278 run osmo-stp_10.42.42.5(pid=17668): stderr: | [0;m[38;5;43m20221214001239126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001239126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001239126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001239127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001239127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001239127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001239127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:40.760677 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17668): Process ended prematurely: osmo-stp_10.42.42.5(pid=17668) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17668)] [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:12:40.769520 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 00:12:40.795529 run osmo-hlr_10.42.42.2(pid=17665): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17665)] 00:12:40.842471 run osmo-hlr_10.42.42.2(pid=17665): stdout: | (launched: 2022-12-14_00:12:38.028940) 00:12:40.891193 run osmo-hlr_10.42.42.2(pid=17665): stderr: | [0;m[1;31m20221214001238206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001238206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001238206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001238206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001238206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001238206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001238217 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001238226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001238226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001238226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:40.959269 run osmo-msc_10.42.42.6(pid=17671): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17671)] 00:12:41.006433 run osmo-msc_10.42.42.6(pid=17671): stdout: | (launched: 2022-12-14_00:12:39.904880) 00:12:41.054986 run osmo-msc_10.42.42.6(pid=17671): stderr: | [0;m[38;5;43m20221214001240175 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001240175 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fef5aeb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001240175 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001240175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001240175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001240176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001240177 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001240178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001240178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001240178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:12:41.103941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17664): Terminating (SIGTERM) 00:12:41.142970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17667): Terminating (SIGTERM) 00:12:41.181963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17670): Terminating (SIGTERM) 00:12:41.221286 --- ParallelTerminationStrategy: PID 17664 died... 00:12:41.240156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17664): Terminated: ok {rc=0} 00:12:41.283558 --- ParallelTerminationStrategy: PID 17667 died... 00:12:41.302125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17667): Terminated: ok {rc=0} 00:12:41.345364 --- ParallelTerminationStrategy: PID 17670 died... 00:12:41.363563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17670): Terminated: ok {rc=0} 00:12:41.448305 bus /sierra_3: Setting Powered False 00:12:42.546315 bus /sierra_3: Setting Powered False 00:12:43.658576 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:12:44.805771 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:44.817977 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:12:44.879163 tst mo_mt_call_osmux.py: using LAC 37206 00:12:45.002661 tst mo_mt_call_osmux.py: using RAC 231 00:12:45.126526 tst mo_mt_call_osmux.py: using CellId 37206 00:12:45.251806 tst mo_mt_call_osmux.py: using BVCI 37207 00:12:45.366975 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:45.378641 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:45.390138 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:45.401588 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:45.413489 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:45.425224 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:12:45.542493 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:12:45.660821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:46.178600 run create_hlr_db(pid=17673): Launched 00:12:46.303158 bus /sierra_2: Setting Powered False 00:12:47.366421 run create_hlr_db(pid=17673): Terminated: ok {rc=0} 00:12:47.793562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17675): Launched 00:12:48.091398 run osmo-hlr_10.42.42.2(pid=17676): Launched 00:12:48.203963 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:48.730661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17678): Launched 00:12:49.027711 run osmo-stp_10.42.42.5(pid=17679): Launched 00:12:49.139761 run osmo-msc_10.42.42.6: Starting osmo-msc 00:12:49.677330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17681): Launched 00:12:49.976030 run osmo-msc_10.42.42.6(pid=17682): Launched 00:12:50.143592 run osmo-stp_10.42.42.5(pid=17679): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17679)] 00:12:50.269698 run osmo-stp_10.42.42.5(pid=17679): stdout: | (launched: 2022-12-14_00:12:48.972834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:50.396052 run osmo-stp_10.42.42.5(pid=17679): stderr: | [0;m[38;5;43m20221214001249145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001249145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001249145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001249146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001249146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001249146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001249146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:50.519942 run osmo-stp_10.42.42.5(pid=17679): stdout: | (launched: 2022-12-14_00:12:48.972834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:50.638870 run osmo-stp_10.42.42.5(pid=17679): stderr: | [0;m[38;5;43m20221214001249145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001249145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001249145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001249146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001249146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001249146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001249146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:50.780785 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17679): Process ended prematurely: osmo-stp_10.42.42.5(pid=17679) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17679)] [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:12:50.789686 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:12:50.815884 run osmo-hlr_10.42.42.2(pid=17676): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17676)] 00:12:50.863669 run osmo-hlr_10.42.42.2(pid=17676): stdout: | (launched: 2022-12-14_00:12:48.036728) 00:12:50.912510 run osmo-hlr_10.42.42.2(pid=17676): stderr: | [0;m[1;31m20221214001248215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001248215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001248215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001248215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001248215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001248215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001248229 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001248239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001248239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001248239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:50.980830 run osmo-msc_10.42.42.6(pid=17682): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17682)] 00:12:51.027991 run osmo-msc_10.42.42.6(pid=17682): stdout: | (launched: 2022-12-14_00:12:49.921335) 00:12:51.076912 run osmo-msc_10.42.42.6(pid=17682): stderr: | [0;m[38;5;43m20221214001250195 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001250195 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f884b9bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001250195 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001250195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001250195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001250195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001250197 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001250198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001250198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001250198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:12:51.126122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17675): Terminating (SIGTERM) 00:12:51.165486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17678): Terminating (SIGTERM) 00:12:51.204752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17681): Terminating (SIGTERM) 00:12:51.244303 --- ParallelTerminationStrategy: PID 17675 died... 00:12:51.263057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17675): Terminated: ok {rc=0} 00:12:51.306670 --- ParallelTerminationStrategy: PID 17678 died... 00:12:51.325196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17678): Terminated: ok {rc=0} 00:12:51.368383 --- ParallelTerminationStrategy: PID 17681 died... 00:12:51.386793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17681): Terminated: ok {rc=0} 00:12:51.468065 bus /sierra_3: Setting Powered False 00:12:52.565461 bus /sierra_3: Setting Powered False 00:12:53.682161 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:12:54.927629 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:54.935508 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:12:54.959560 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:12:54.987647 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:12:55.045283 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:12:55.068735 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:12:55.094806 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:12:55.646773 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:12:55.698271 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:55.709777 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:12:55.768630 tst mo_mt_call.py: using LAC 37207 00:12:55.896230 tst mo_mt_call.py: using RAC 232 00:12:56.018131 tst mo_mt_call.py: using CellId 37207 00:12:56.141780 tst mo_mt_call.py: using BVCI 37208 00:12:56.256533 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:56.268129 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:56.279635 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:56.291030 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:56.302912 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:56.314633 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:12:56.430860 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:12:56.550603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:57.042127 run create_hlr_db(pid=17687): Launched 00:12:57.163809 bus /sierra_2: Setting Powered False 00:12:58.222757 run create_hlr_db(pid=17687): Terminated: ok {rc=0} 00:12:58.664334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17689): Launched 00:12:58.981644 run osmo-hlr_10.42.42.2(pid=17690): Launched 00:12:59.104419 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:59.651297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17692): Launched 00:12:59.968583 run osmo-stp_10.42.42.5(pid=17693): Launched 00:13:00.090888 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:00.643157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17695): Launched 00:13:00.969689 run osmo-msc_10.42.42.6(pid=17696): Launched 00:13:01.294714 run osmo-stp_10.42.42.5(pid=17693): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17693)] 00:13:01.481517 run osmo-stp_10.42.42.5(pid=17693): stdout: | (launched: 2022-12-14_00:12:59.910845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:01.687884 run osmo-stp_10.42.42.5(pid=17693): stderr: | [0;m[38;5;43m20221214001300101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001300101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001300102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001300102 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001300104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001300104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001300104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:01.825490 run osmo-stp_10.42.42.5(pid=17693): stdout: | (launched: 2022-12-14_00:12:59.910845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:01.958144 run osmo-stp_10.42.42.5(pid=17693): stderr: | [0;m[38;5;43m20221214001300101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001300101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001300102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001300102 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001300104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001300104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001300104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:02.118114 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17693): Process ended prematurely: osmo-stp_10.42.42.5(pid=17693) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17693)] [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:13:02.128524 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 00:13:02.157576 run osmo-hlr_10.42.42.2(pid=17690): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17690)] 00:13:02.212321 run osmo-hlr_10.42.42.2(pid=17690): stdout: | (launched: 2022-12-14_00:12:58.924024) 00:13:02.268685 run osmo-hlr_10.42.42.2(pid=17690): stderr: | [0;m[1;31m20221214001259121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001259121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001259121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001259121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001259121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001259121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001259136 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001259146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001259146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001259146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:02.343051 run osmo-msc_10.42.42.6(pid=17696): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17696)] 00:13:02.393181 run osmo-msc_10.42.42.6(pid=17696): stdout: | (launched: 2022-12-14_00:13:00.899413) 00:13:02.445860 run osmo-msc_10.42.42.6(pid=17696): stderr: | [0;m[38;5;43m20221214001301344 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001301344 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4b2ed8ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001301345 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001301345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001301345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001301345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001301347 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001301347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001301347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001301347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:02.498793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17689): Terminating (SIGTERM) 00:13:02.541183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17692): Terminating (SIGTERM) 00:13:02.583733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17695): Terminating (SIGTERM) 00:13:02.626485 --- ParallelTerminationStrategy: PID 17689 died... 00:13:02.647417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17689): Terminated: ok {rc=0} 00:13:02.694391 --- ParallelTerminationStrategy: PID 17692 died... 00:13:02.714908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17692): Terminated: ok {rc=0} 00:13:02.761552 --- ParallelTerminationStrategy: PID 17695 died... 00:13:02.782054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17695): Terminated: ok {rc=0} 00:13:02.870893 bus /sierra_3: Setting Powered False 00:13:03.969231 bus /sierra_3: Setting Powered False 00:13:05.084437 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:13:06.231275 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:06.243401 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:13:06.304282 tst mo_mt_call_osmux.py: using LAC 37208 00:13:06.427999 tst mo_mt_call_osmux.py: using RAC 233 00:13:06.551781 tst mo_mt_call_osmux.py: using CellId 37208 00:13:06.676023 tst mo_mt_call_osmux.py: using BVCI 37209 00:13:06.791442 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:06.803067 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:06.814597 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:06.826130 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:06.837934 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:06.849645 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:13:06.969351 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:13:07.086851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:07.549877 run create_hlr_db(pid=17698): Launched 00:13:07.672900 bus /sierra_2: Setting Powered False 00:13:08.732823 run create_hlr_db(pid=17698): Terminated: ok {rc=0} 00:13:09.148858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17700): Launched 00:13:09.446514 run osmo-hlr_10.42.42.2(pid=17701): Launched 00:13:09.560010 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:10.087764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17703): Launched 00:13:10.385415 run osmo-stp_10.42.42.5(pid=17704): Launched 00:13:10.498145 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:11.036554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17706): Launched 00:13:11.334856 run osmo-msc_10.42.42.6(pid=17707): Launched 00:13:11.501493 run osmo-stp_10.42.42.5(pid=17704): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17704)] 00:13:11.628136 run osmo-stp_10.42.42.5(pid=17704): stdout: | (launched: 2022-12-14_00:13:10.330526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:11.754489 run osmo-stp_10.42.42.5(pid=17704): stderr: | [0;m[38;5;43m20221214001310500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001310501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001310501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001310501 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001310502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001310502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001310502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:11.879033 run osmo-stp_10.42.42.5(pid=17704): stdout: | (launched: 2022-12-14_00:13:10.330526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:11.998881 run osmo-stp_10.42.42.5(pid=17704): stderr: | [0;m[38;5;43m20221214001310500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001310501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001310501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001310501 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001310502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001310502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001310502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:12.141419 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17704): Process ended prematurely: osmo-stp_10.42.42.5(pid=17704) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17704)] [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:13:12.150323 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:13:12.176460 run osmo-hlr_10.42.42.2(pid=17701): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17701)] 00:13:12.224001 run osmo-hlr_10.42.42.2(pid=17701): stdout: | (launched: 2022-12-14_00:13:09.391901) 00:13:12.273147 run osmo-hlr_10.42.42.2(pid=17701): stderr: | [0;m[1;31m20221214001309568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001309568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001309568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001309568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001309568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001309568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001309580 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001309589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001309590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001309590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:12.341542 run osmo-msc_10.42.42.6(pid=17707): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17707)] 00:13:12.388505 run osmo-msc_10.42.42.6(pid=17707): stdout: | (launched: 2022-12-14_00:13:11.280208) 00:13:12.437371 run osmo-msc_10.42.42.6(pid=17707): stderr: | [0;m[38;5;43m20221214001311551 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001311551 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f46228d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001311552 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001311552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001311552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001311552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001311554 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001311554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001311554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001311554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:12.486331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17700): Terminating (SIGTERM) 00:13:12.525481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17703): Terminating (SIGTERM) 00:13:12.564635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17706): Terminating (SIGTERM) 00:13:12.603989 --- ParallelTerminationStrategy: PID 17700 died... 00:13:12.623162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17700): Terminated: ok {rc=0} 00:13:12.666739 --- ParallelTerminationStrategy: PID 17703 died... 00:13:12.685190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17703): Terminated: ok {rc=0} 00:13:12.729079 --- ParallelTerminationStrategy: PID 17706 died... 00:13:12.747756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17706): Terminated: ok {rc=0} 00:13:12.833658 bus /sierra_3: Setting Powered False 00:13:13.931881 bus /sierra_3: Setting Powered False 00:13:15.045224 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:13:16.296466 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:13:16.308536 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:13:16.344996 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:13:16.382521 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:13:16.446821 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:13:16.472848 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:13:16.503243 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:13:17.086350 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:13:17.144084 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:17.156803 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:13:17.221709 tst mo_mt_call.py: using LAC 37209 00:13:17.349641 tst mo_mt_call.py: using RAC 234 00:13:17.467136 tst mo_mt_call.py: using CellId 37209 00:13:17.582918 tst mo_mt_call.py: using BVCI 37210 00:13:17.692120 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:17.703464 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:17.714611 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:17.725505 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:17.736562 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:17.747550 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:13:17.862301 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:13:17.982798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:18.475191 run create_hlr_db(pid=17712): Launched 00:13:18.596646 bus /sierra_2: Setting Powered False 00:13:19.659660 run create_hlr_db(pid=17712): Terminated: ok {rc=0} 00:13:20.103323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17714): Launched 00:13:20.420395 run osmo-hlr_10.42.42.2(pid=17715): Launched 00:13:20.542334 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:21.088126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17717): Launched 00:13:21.406430 run osmo-stp_10.42.42.5(pid=17718): Launched 00:13:21.528183 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:22.103307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17720): Launched 00:13:22.421033 run osmo-msc_10.42.42.6(pid=17721): Launched 00:13:22.599015 run osmo-stp_10.42.42.5(pid=17718): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17718)] 00:13:22.733844 run osmo-stp_10.42.42.5(pid=17718): stdout: | (launched: 2022-12-14_00:13:21.348565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:22.869239 run osmo-stp_10.42.42.5(pid=17718): stderr: | [0;m[38;5;43m20221214001321539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001321539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001321539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001321540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001321540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001321540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001321540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:23.003538 run osmo-stp_10.42.42.5(pid=17718): stdout: | (launched: 2022-12-14_00:13:21.348565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:23.130594 run osmo-stp_10.42.42.5(pid=17718): stderr: | [0;m[38;5;43m20221214001321539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001321539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001321539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001321540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001321540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001321540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001321540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:23.282095 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17718): Process ended prematurely: osmo-stp_10.42.42.5(pid=17718) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17718)] [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:13:23.291553 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:13:23.319199 run osmo-hlr_10.42.42.2(pid=17715): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17715)] 00:13:23.369460 run osmo-hlr_10.42.42.2(pid=17715): stdout: | (launched: 2022-12-14_00:13:20.362566) 00:13:23.420930 run osmo-hlr_10.42.42.2(pid=17715): stderr: | [0;m[1;31m20221214001320561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001320561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001320561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001320561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001320561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001320561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001320593 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001320603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001320603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001320603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:23.493267 run osmo-msc_10.42.42.6(pid=17721): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17721)] 00:13:23.542587 run osmo-msc_10.42.42.6(pid=17721): stdout: | (launched: 2022-12-14_00:13:22.363252) 00:13:23.594361 run osmo-msc_10.42.42.6(pid=17721): stderr: | [0;m[38;5;43m20221214001322685 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001322685 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2c77cb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001322685 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001322685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001322686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001322686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001322687 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001322688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001322688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001322688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:23.646085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17714): Terminating (SIGTERM) 00:13:23.687549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17717): Terminating (SIGTERM) 00:13:23.729096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17720): Terminating (SIGTERM) 00:13:23.770802 --- ParallelTerminationStrategy: PID 17714 died... 00:13:23.790897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17714): Terminated: ok {rc=0} 00:13:23.836881 --- ParallelTerminationStrategy: PID 17717 died... 00:13:23.856598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17717): Terminated: ok {rc=0} 00:13:23.902257 --- ParallelTerminationStrategy: PID 17720 died... 00:13:23.921912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17720): Terminated: ok {rc=0} 00:13:24.009534 bus /sierra_3: Setting Powered False 00:13:25.108716 bus /sierra_3: Setting Powered False 00:13:26.224823 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:13:27.371846 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:27.384125 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:13:27.446383 tst mo_mt_call_osmux.py: using LAC 37210 00:13:27.572491 tst mo_mt_call_osmux.py: using RAC 235 00:13:27.698470 tst mo_mt_call_osmux.py: using CellId 37210 00:13:27.822880 tst mo_mt_call_osmux.py: using BVCI 37211 00:13:27.940282 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:27.951930 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:27.963305 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:27.974763 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:27.986611 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:27.998335 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:13:28.117861 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:13:28.237231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:28.728599 run create_hlr_db(pid=17723): Launched 00:13:28.849680 bus /sierra_2: Setting Powered False 00:13:29.912898 run create_hlr_db(pid=17723): Terminated: ok {rc=0} 00:13:30.338871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17725): Launched 00:13:30.636472 run osmo-hlr_10.42.42.2(pid=17726): Launched 00:13:30.750404 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:31.363703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17728): Launched 00:13:31.706347 run osmo-stp_10.42.42.5(pid=17729): Launched 00:13:31.947221 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:32.596045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17731): Launched 00:13:32.898735 run osmo-msc_10.42.42.6(pid=17732): Launched 00:13:33.065257 run osmo-stp_10.42.42.5(pid=17729): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17729)] 00:13:33.191112 run osmo-stp_10.42.42.5(pid=17729): stdout: | (launched: 2022-12-14_00:13:31.633764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:33.317687 run osmo-stp_10.42.42.5(pid=17729): stderr: | [0;m[38;5;43m20221214001331925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001331925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001331925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001331926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001331926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001331926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001331926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:33.442842 run osmo-stp_10.42.42.5(pid=17729): stdout: | (launched: 2022-12-14_00:13:31.633764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:33.562291 run osmo-stp_10.42.42.5(pid=17729): stderr: | [0;m[38;5;43m20221214001331925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001331925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001331925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001331926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001331926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001331926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001331926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:33.705386 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17729): Process ended prematurely: osmo-stp_10.42.42.5(pid=17729) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17729)] [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:13:33.714312 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 00:13:33.740624 run osmo-hlr_10.42.42.2(pid=17726): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17726)] 00:13:33.788295 run osmo-hlr_10.42.42.2(pid=17726): stdout: | (launched: 2022-12-14_00:13:30.581912) 00:13:33.837728 run osmo-hlr_10.42.42.2(pid=17726): stderr: | [0;m[1;31m20221214001330758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001330758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001330758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001330758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001330758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001330758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001330770 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001330779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001330779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001330779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:33.906548 run osmo-msc_10.42.42.6(pid=17732): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17732)] 00:13:33.953665 run osmo-msc_10.42.42.6(pid=17732): stdout: | (launched: 2022-12-14_00:13:32.844067) 00:13:34.002320 run osmo-msc_10.42.42.6(pid=17732): stderr: | [0;m[38;5;43m20221214001333117 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001333118 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbe26682c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001333118 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001333118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001333118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001333118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001333120 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001333120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001333120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001333120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:34.051338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17725): Terminating (SIGTERM) 00:13:34.091206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17728): Terminating (SIGTERM) 00:13:34.130827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17731): Terminating (SIGTERM) 00:13:34.170450 --- ParallelTerminationStrategy: PID 17725 died... 00:13:34.189675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17725): Terminated: ok {rc=0} 00:13:34.233522 --- ParallelTerminationStrategy: PID 17728 died... 00:13:34.252126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17728): Terminated: ok {rc=0} 00:13:34.296228 --- ParallelTerminationStrategy: PID 17731 died... 00:13:34.315039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17731): Terminated: ok {rc=0} 00:13:34.400264 bus /sierra_3: Setting Powered False 00:13:35.499184 bus /sierra_3: Setting Powered False 00:13:36.614395 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:13:37.851881 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:13:37.859086 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:13:37.882479 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:13:37.908705 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:13:37.962213 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:13:37.986293 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:13:38.012518 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:13:38.562673 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:13:38.610690 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:38.622078 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:13:38.681382 tst mo_mt_call.py: using LAC 37211 00:13:38.799924 tst mo_mt_call.py: using RAC 236 00:13:38.918386 tst mo_mt_call.py: using CellId 37211 00:13:39.040137 tst mo_mt_call.py: using BVCI 37212 00:13:39.148897 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:39.160086 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:39.170979 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:39.181963 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:39.193015 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:39.204422 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:13:39.325275 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:13:39.439433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:39.900610 run create_hlr_db(pid=17738): Launched 00:13:40.021602 bus /sierra_2: Setting Powered False 00:13:41.080825 run create_hlr_db(pid=17738): Terminated: ok {rc=0} 00:13:41.496234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17740): Launched 00:13:41.793435 run osmo-hlr_10.42.42.2(pid=17741): Launched 00:13:41.906337 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:42.416733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17743): Launched 00:13:42.713738 run osmo-stp_10.42.42.5(pid=17744): Launched 00:13:42.826554 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:43.364366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17746): Launched 00:13:43.662150 run osmo-msc_10.42.42.6(pid=17747): Launched 00:13:43.827951 run osmo-stp_10.42.42.5(pid=17744): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17744)] 00:13:43.961554 run osmo-stp_10.42.42.5(pid=17744): stdout: | (launched: 2022-12-14_00:13:42.659398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:44.099401 run osmo-stp_10.42.42.5(pid=17744): stderr: | [0;m[38;5;43m20221214001342831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001342831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001342832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001342832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001342832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001342833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001342833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:44.232929 run osmo-stp_10.42.42.5(pid=17744): stdout: | (launched: 2022-12-14_00:13:42.659398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:44.360232 run osmo-stp_10.42.42.5(pid=17744): stderr: | [0;m[38;5;43m20221214001342831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001342831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001342832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001342832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001342832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001342833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001342833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:44.512345 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17744): Process ended prematurely: osmo-stp_10.42.42.5(pid=17744) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17744)] [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:13:44.522169 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 00:13:44.549958 run osmo-hlr_10.42.42.2(pid=17741): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17741)] 00:13:44.602048 run osmo-hlr_10.42.42.2(pid=17741): stdout: | (launched: 2022-12-14_00:13:41.738743) 00:13:44.654444 run osmo-hlr_10.42.42.2(pid=17741): stderr: | [0;m[1;31m20221214001341915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001341915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001341915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001341915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001341915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001341915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001341927 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001341936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001341936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001341936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:44.727915 run osmo-msc_10.42.42.6(pid=17747): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17747)] 00:13:44.777653 run osmo-msc_10.42.42.6(pid=17747): stdout: | (launched: 2022-12-14_00:13:43.607459) 00:13:44.830155 run osmo-msc_10.42.42.6(pid=17747): stderr: | [0;m[38;5;43m20221214001343879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001343879 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1a7efe6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001343879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001343879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001343880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001343880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001343882 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001343882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001343882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001343882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:44.883057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17740): Terminating (SIGTERM) 00:13:44.925291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17743): Terminating (SIGTERM) 00:13:44.967743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17746): Terminating (SIGTERM) 00:13:45.010655 --- ParallelTerminationStrategy: PID 17740 died... 00:13:45.031519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17740): Terminated: ok {rc=0} 00:13:45.078757 --- ParallelTerminationStrategy: PID 17743 died... 00:13:45.099514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17743): Terminated: ok {rc=0} 00:13:45.146439 --- ParallelTerminationStrategy: PID 17746 died... 00:13:45.166951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17746): Terminated: ok {rc=0} 00:13:45.256100 bus /sierra_3: Setting Powered False 00:13:46.359185 bus /sierra_3: Setting Powered False 00:13:47.486902 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:13:48.632068 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:48.643815 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:13:48.703491 tst mo_mt_call_osmux.py: using LAC 37212 00:13:48.820132 tst mo_mt_call_osmux.py: using RAC 237 00:13:48.936565 tst mo_mt_call_osmux.py: using CellId 37212 00:13:49.054866 tst mo_mt_call_osmux.py: using BVCI 37213 00:13:49.164470 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:49.175613 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:49.186691 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:49.197627 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:49.208615 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:49.219608 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:13:49.340325 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:13:49.462804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:49.953661 run create_hlr_db(pid=17749): Launched 00:13:50.074474 bus /sierra_2: Setting Powered False 00:13:51.138130 run create_hlr_db(pid=17749): Terminated: ok {rc=0} 00:13:51.563164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17751): Launched 00:13:51.860299 run osmo-hlr_10.42.42.2(pid=17752): Launched 00:13:51.974116 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:52.487170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17754): Launched 00:13:52.784035 run osmo-stp_10.42.42.5(pid=17755): Launched 00:13:52.896703 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:53.450681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17757): Launched 00:13:53.747676 run osmo-msc_10.42.42.6(pid=17758): Launched 00:13:53.913703 run osmo-stp_10.42.42.5(pid=17755): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17755)] 00:13:54.039008 run osmo-stp_10.42.42.5(pid=17755): stdout: | (launched: 2022-12-14_00:13:52.729305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:54.164883 run osmo-stp_10.42.42.5(pid=17755): stderr: | [0;m[38;5;43m20221214001352899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001352899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001352899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001352900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001352900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001352900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001352900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:54.289296 run osmo-stp_10.42.42.5(pid=17755): stdout: | (launched: 2022-12-14_00:13:52.729305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:54.407483 run osmo-stp_10.42.42.5(pid=17755): stderr: | [0;m[38;5;43m20221214001352899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001352899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001352899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001352900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001352900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001352900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001352900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:54.548575 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17755): Process ended prematurely: osmo-stp_10.42.42.5(pid=17755) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17755)] [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:13:54.557395 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:13:54.583467 run osmo-hlr_10.42.42.2(pid=17752): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17752)] 00:13:54.630620 run osmo-hlr_10.42.42.2(pid=17752): stdout: | (launched: 2022-12-14_00:13:51.805794) 00:13:54.679486 run osmo-hlr_10.42.42.2(pid=17752): stderr: | [0;m[1;31m20221214001351982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001351982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001351982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001351982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001351982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001351982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001351994 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001352003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001352003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001352003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:54.747988 run osmo-msc_10.42.42.6(pid=17758): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17758)] 00:13:54.795211 run osmo-msc_10.42.42.6(pid=17758): stdout: | (launched: 2022-12-14_00:13:53.692929) 00:13:54.843923 run osmo-msc_10.42.42.6(pid=17758): stderr: | [0;m[38;5;43m20221214001353965 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001353965 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe0c719c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001353965 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001353965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001353965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001353966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001353967 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001353968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001353968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001353968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:54.892862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17751): Terminating (SIGTERM) 00:13:54.931992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17754): Terminating (SIGTERM) 00:13:54.971040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17757): Terminating (SIGTERM) 00:13:55.010374 --- ParallelTerminationStrategy: PID 17751 died... 00:13:55.029186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17751): Terminated: ok {rc=0} 00:13:55.072509 --- ParallelTerminationStrategy: PID 17754 died... 00:13:55.090955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17754): Terminated: ok {rc=0} 00:13:55.134113 --- ParallelTerminationStrategy: PID 17757 died... 00:13:55.152415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17757): Terminated: ok {rc=0} 00:13:55.238401 bus /sierra_3: Setting Powered False 00:13:56.336048 bus /sierra_3: Setting Powered False 00:13:57.449685 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:13:58.686510 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:13:58.693909 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:13:58.717291 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:13:58.743606 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:13:58.796205 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:13:58.820756 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:13:58.847149 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:13:59.397020 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:13:59.445071 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:13:59.456335 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:13:59.515257 tst mo_mt_call.py: using LAC 37213 00:13:59.633558 tst mo_mt_call.py: using RAC 238 00:13:59.758564 tst mo_mt_call.py: using CellId 37213 00:13:59.882531 tst mo_mt_call.py: using BVCI 37214 00:13:59.997808 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:00.009721 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:00.021495 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:00.033110 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:00.045132 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:00.056835 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:14:00.176365 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:14:00.296759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:00.788391 run create_hlr_db(pid=17763): Launched 00:14:00.911489 bus /sierra_2: Setting Powered False 00:14:01.990609 run create_hlr_db(pid=17763): Terminated: ok {rc=0} 00:14:02.502570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17765): Launched 00:14:02.820651 run osmo-hlr_10.42.42.2(pid=17766): Launched 00:14:02.943107 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:03.493689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17768): Launched 00:14:03.810546 run osmo-stp_10.42.42.5(pid=17769): Launched 00:14:03.931011 run osmo-msc_10.42.42.6: Starting osmo-msc 00:14:04.509769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17771): Launched 00:14:04.827859 run osmo-msc_10.42.42.6(pid=17772): Launched 00:14:05.005750 run osmo-stp_10.42.42.5(pid=17769): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17769)] 00:14:05.141075 run osmo-stp_10.42.42.5(pid=17769): stdout: | (launched: 2022-12-14_00:14:03.752851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:05.276588 run osmo-stp_10.42.42.5(pid=17769): stderr: | [0;m[38;5;43m20221214001403943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001403943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001403943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001403943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001403946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001403946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001403946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:05.411068 run osmo-stp_10.42.42.5(pid=17769): stdout: | (launched: 2022-12-14_00:14:03.752851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:05.537757 run osmo-stp_10.42.42.5(pid=17769): stderr: | [0;m[38;5;43m20221214001403943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001403943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001403943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001403943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001403946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001403946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001403946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:05.688921 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17769): Process ended prematurely: osmo-stp_10.42.42.5(pid=17769) [trial-2396↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17769)] [trial-2396↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:14:05.698600 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 00:14:05.726267 run osmo-hlr_10.42.42.2(pid=17766): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17766)] 00:14:05.776535 run osmo-hlr_10.42.42.2(pid=17766): stdout: | (launched: 2022-12-14_00:14:02.762983) 00:14:05.828266 run osmo-hlr_10.42.42.2(pid=17766): stderr: | [0;m[1;31m20221214001402960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001402960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001402960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001402960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001402960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001402960 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001402973 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001402981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001402981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001402982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:05.900600 run osmo-msc_10.42.42.6(pid=17772): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17772)] 00:14:05.950170 run osmo-msc_10.42.42.6(pid=17772): stdout: | (launched: 2022-12-14_00:14:04.769935) 00:14:06.001701 run osmo-msc_10.42.42.6(pid=17772): stderr: | [0;m[38;5;43m20221214001405089 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001405089 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5a4c825c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001405089 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001405089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001405089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001405089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001405091 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001405091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001405092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001405092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:14:06.053433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17765): Terminating (SIGTERM) 00:14:06.094780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17768): Terminating (SIGTERM) 00:14:06.136652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17771): Terminating (SIGTERM) 00:14:06.178679 --- ParallelTerminationStrategy: PID 17765 died... 00:14:06.198856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17765): Terminated: ok {rc=0} 00:14:06.245029 --- ParallelTerminationStrategy: PID 17768 died... 00:14:06.264583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17768): Terminated: ok {rc=0} 00:14:06.310626 --- ParallelTerminationStrategy: PID 17771 died... 00:14:06.330432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17771): Terminated: ok {rc=0} 00:14:06.418225 bus /sierra_3: Setting Powered False 00:14:07.516619 bus /sierra_3: Setting Powered False 00:14:08.634706 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:14:09.778991 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:09.790787 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:14:09.853643 tst mo_mt_call_osmux.py: using LAC 37214 00:14:09.972666 tst mo_mt_call_osmux.py: using RAC 239 00:14:10.089743 tst mo_mt_call_osmux.py: using CellId 37214 00:14:10.206551 tst mo_mt_call_osmux.py: using BVCI 37215 00:14:10.316423 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:10.327698 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:10.338806 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:10.349795 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:10.360915 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:10.371880 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:14:10.489102 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:14:10.610591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:11.070407 run create_hlr_db(pid=17774): Launched 00:14:11.191214 bus /sierra_2: Setting Powered False 00:14:12.251745 run create_hlr_db(pid=17774): Terminated: ok {rc=0} 00:14:12.687183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17776): Launched 00:14:13.005212 run osmo-hlr_10.42.42.2(pid=17777): Launched 00:14:13.127695 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:13.679299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17779): Launched 00:14:13.997923 run osmo-stp_10.42.42.5(pid=17780): Launched 00:14:14.120577 run osmo-msc_10.42.42.6: Starting osmo-msc 00:14:14.697466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17782): Launched 00:14:15.015449 run osmo-msc_10.42.42.6(pid=17783): Launched 00:14:15.195139 run osmo-stp_10.42.42.5(pid=17780): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17780)] 00:14:15.329943 run osmo-stp_10.42.42.5(pid=17780): stdout: | (launched: 2022-12-14_00:14:13.939969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:15.465374 run osmo-stp_10.42.42.5(pid=17780): stderr: | [0;m[38;5;43m20221214001414130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001414130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001414130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001414131 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001414131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001414131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001414131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:15.599507 run osmo-stp_10.42.42.5(pid=17780): stdout: | (launched: 2022-12-14_00:14:13.939969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:15.726458 run osmo-stp_10.42.42.5(pid=17780): stderr: | [0;m[38;5;43m20221214001414130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001414130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001414130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001414131 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001414131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001414131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001414131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:15.889442 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17780): Process ended prematurely: osmo-stp_10.42.42.5(pid=17780) [trial-2396↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17780)] [trial-2396↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:14:15.899395 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:14:15.942378 run osmo-hlr_10.42.42.2(pid=17777): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17777)] 00:14:15.993851 run osmo-hlr_10.42.42.2(pid=17777): stdout: | (launched: 2022-12-14_00:14:12.947239) 00:14:16.049701 run osmo-hlr_10.42.42.2(pid=17777): stderr: | [0;m[1;31m20221214001413146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001413146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001413146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001413146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001413146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001413146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001413158 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001413166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001413166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001413166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:16.124250 run osmo-msc_10.42.42.6(pid=17783): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17783)] 00:14:16.175536 run osmo-msc_10.42.42.6(pid=17783): stdout: | (launched: 2022-12-14_00:14:14.957231) 00:14:16.229363 run osmo-msc_10.42.42.6(pid=17783): stderr: | [0;m[38;5;43m20221214001415278 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001415278 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5b8b0dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001415279 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001415279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001415279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001415279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001415281 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001415281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001415281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001415281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:14:16.285266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17776): Terminating (SIGTERM) 00:14:16.328593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17779): Terminating (SIGTERM) 00:14:16.373796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17782): Terminating (SIGTERM) 00:14:16.418358 --- ParallelTerminationStrategy: PID 17776 died... 00:14:16.440320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17776): Terminated: ok {rc=0} 00:14:16.489594 --- ParallelTerminationStrategy: PID 17779 died... 00:14:16.510966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17779): Terminated: ok {rc=0} 00:14:16.559399 --- ParallelTerminationStrategy: PID 17782 died... 00:14:16.581229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17782): Terminated: ok {rc=0} 00:14:16.672076 bus /sierra_3: Setting Powered False 00:14:17.770645 bus /sierra_3: Setting Powered False 00:14:18.887343 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 emergency:nanobts+band-1900 --------------------------------------------------------------------- 00:14:20.129165 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:14:20.134682 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:14:20.158810 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 00:14:20.188748 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 00:14:20.271367 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:14:20.295016 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 00:14:20.321457 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 00:14:20.908137 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2396 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 00:14:20.913391 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:20.924085 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:14:20.962717 tst emergency_mo_mt_call.py: using LAC 37215 00:14:21.075432 tst emergency_mo_mt_call.py: using RAC 240 00:14:21.188698 tst emergency_mo_mt_call.py: using CellId 37215 00:14:21.301103 tst emergency_mo_mt_call.py: using BVCI 37216 00:14:21.406463 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:21.417240 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:21.427865 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:21.438383 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:21.448765 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:21.459327 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:21.570846 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:21.684097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:22.135072 run create_hlr_db(pid=17788): Launched 00:14:22.253921 bus /sierra_2: Setting Powered False 00:14:23.312439 run create_hlr_db(pid=17788): Terminated: ok {rc=0} 00:14:23.741626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17790): Launched 00:14:24.053416 run osmo-hlr_10.42.42.2(pid=17791): Launched 00:14:24.172647 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:24.711400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17793): Launched 00:14:25.022674 run osmo-stp_10.42.42.5(pid=17794): Launched 00:14:25.150713 tst emergency_mo_mt_call.py: using MSISDN 8399 00:14:25.314931 run osmo-msc_10.42.42.6: Starting osmo-msc 00:14:25.876268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17796): Launched 00:14:26.188205 run osmo-msc_10.42.42.6(pid=17797): Launched 00:14:26.362351 run osmo-stp_10.42.42.5(pid=17794): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17794)] 00:14:26.494768 run osmo-stp_10.42.42.5(pid=17794): stdout: | (launched: 2022-12-14_00:14:24.965770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:26.627874 run osmo-stp_10.42.42.5(pid=17794): stderr: | [0;m[38;5;43m20221214001425157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001425157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001425157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001425158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001425158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001425158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001425158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:26.760283 run osmo-stp_10.42.42.5(pid=17794): stdout: | (launched: 2022-12-14_00:14:24.965770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:26.884676 run osmo-stp_10.42.42.5(pid=17794): stderr: | [0;m[38;5;43m20221214001425157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001425157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001425157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001425158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001425158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001425158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001425158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:27.033416 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=17794): Process ended prematurely: osmo-stp_10.42.42.5(pid=17794) [trial-2396↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17794)] [trial-2396↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 00:14:27.042382 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 00:14:27.069298 run osmo-hlr_10.42.42.2(pid=17791): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17791)] 00:14:27.119893 run osmo-hlr_10.42.42.2(pid=17791): stdout: | (launched: 2022-12-14_00:14:23.996730) 00:14:27.171521 run osmo-hlr_10.42.42.2(pid=17791): stderr: | [0;m[1;31m20221214001424192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001424192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001424192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001424192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001424193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001424193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001424205 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001424213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001424213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001424213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:27.243956 run osmo-msc_10.42.42.6(pid=17797): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17797)] 00:14:27.293525 run osmo-msc_10.42.42.6(pid=17797): stdout: | (launched: 2022-12-14_00:14:26.131161) 00:14:27.344924 run osmo-msc_10.42.42.6(pid=17797): stderr: | [0;m[38;5;43m20221214001426453 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001426453 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb936b9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001426453 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001426453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001426453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001426454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001426455 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001426456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001426456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001426456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:14:27.396587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17790): Terminating (SIGTERM) 00:14:27.438308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17793): Terminating (SIGTERM) 00:14:27.479816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17796): Terminating (SIGTERM) 00:14:27.521467 --- ParallelTerminationStrategy: PID 17790 died... 00:14:27.541729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17790): Terminated: ok {rc=0} 00:14:27.587774 --- ParallelTerminationStrategy: PID 17793 died... 00:14:27.607440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17793): Terminated: ok {rc=0} 00:14:27.653412 --- ParallelTerminationStrategy: PID 17796 died... 00:14:27.673200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17796): Terminated: ok {rc=0} 00:14:27.759970 bus /sierra_3: Setting Powered False 00:14:28.858203 bus /sierra_3: Setting Powered False 00:14:29.973880 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 00:14:31.058730 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:31.071267 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:14:31.112376 tst emergency_preemptive_call.py: using LAC 37216 00:14:31.258903 tst emergency_preemptive_call.py: using RAC 241 00:14:31.381379 tst emergency_preemptive_call.py: using CellId 37216 00:14:31.520270 tst emergency_preemptive_call.py: using BVCI 37217 00:14:31.631448 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:31.644047 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:31.655630 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:31.667494 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:31.678995 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:31.690491 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:31.830675 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:31.947595 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:32.063982 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:32.182260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:32.671158 run create_hlr_db(pid=17799): Launched 00:14:32.791089 bus /sierra_2: Setting Powered False 00:14:33.853665 run create_hlr_db(pid=17799): Terminated: ok {rc=0} 00:14:34.273981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17801): Launched 00:14:34.565670 run osmo-hlr_10.42.42.2(pid=17802): Launched 00:14:34.678054 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:35.181970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17804): Launched 00:14:35.473813 run osmo-stp_10.42.42.5(pid=17805): Launched 00:14:35.594671 tst emergency_preemptive_call.py: using MSISDN 8400 00:14:35.745087 run osmo-msc_10.42.42.6: Starting osmo-msc 00:14:36.271024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17807): Launched 00:14:36.564156 run osmo-msc_10.42.42.6(pid=17808): Launched 00:14:36.729963 run osmo-stp_10.42.42.5(pid=17805): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17805)] 00:14:36.853716 run osmo-stp_10.42.42.5(pid=17805): stdout: | (launched: 2022-12-14_00:14:35.419894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:36.978262 run osmo-stp_10.42.42.5(pid=17805): stderr: | [0;m[38;5;43m20221214001435590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001435591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001435591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001435591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001435592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001435592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001435592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:37.100698 run osmo-stp_10.42.42.5(pid=17805): stdout: | (launched: 2022-12-14_00:14:35.419894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:37.217510 run osmo-stp_10.42.42.5(pid=17805): stderr: | [0;m[38;5;43m20221214001435590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001435591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001435591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001435591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001435592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001435592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001435592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:37.356682 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=17805): Process ended prematurely: osmo-stp_10.42.42.5(pid=17805) [trial-2396↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17805)] [trial-2396↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 00:14:37.364783 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 00:14:37.390685 run osmo-hlr_10.42.42.2(pid=17802): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17802)] 00:14:37.437748 run osmo-hlr_10.42.42.2(pid=17802): stdout: | (launched: 2022-12-14_00:14:34.511724) 00:14:37.486923 run osmo-hlr_10.42.42.2(pid=17802): stderr: | [0;m[1;31m20221214001434688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001434688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001434688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001434688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001434688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001434689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001434701 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001434710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001434710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001434710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:37.555587 run osmo-msc_10.42.42.6(pid=17808): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17808)] 00:14:37.602930 run osmo-msc_10.42.42.6(pid=17808): stdout: | (launched: 2022-12-14_00:14:36.509651) 00:14:37.651763 run osmo-msc_10.42.42.6(pid=17808): stderr: | [0;m[38;5;43m20221214001436781 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001436781 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6d5e9afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001436781 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001436782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001436782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001436782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001436784 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001436784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001436784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001436784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:14:37.701144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17801): Terminating (SIGTERM) 00:14:37.740427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17804): Terminating (SIGTERM) 00:14:37.779817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17807): Terminating (SIGTERM) 00:14:37.819516 --- ParallelTerminationStrategy: PID 17801 died... 00:14:37.838474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17801): Terminated: ok {rc=0} 00:14:37.882804 --- ParallelTerminationStrategy: PID 17804 died... 00:14:37.901461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17804): Terminated: ok {rc=0} 00:14:37.944911 --- ParallelTerminationStrategy: PID 17807 died... 00:14:37.963699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17807): Terminated: ok {rc=0} 00:14:38.048263 bus /sierra_9: Setting Powered False 00:14:39.146503 bus /sierra_9: Setting Powered False 00:14:40.259393 bus /sierra_8: Setting Powered False 00:14:41.355721 bus /sierra_8: Setting Powered False 00:14:42.471085 bus /sierra_3: Setting Powered False 00:14:43.567934 bus /sierra_3: Setting Powered False 00:14:44.683395 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-1900 --------------------------------------------------------------------- 00:14:45.966454 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:14:45.972400 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:14:46.001798 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 00:14:46.045564 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 00:14:46.135892 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:14:46.169950 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 00:14:46.222384 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 00:14:46.788812 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 00:14:46.838848 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:46.850103 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:14:46.888669 tst cs_paging_gprs_active.py: using LAC 37217 00:14:47.042300 tst cs_paging_gprs_active.py: using RAC 242 00:14:47.161077 tst cs_paging_gprs_active.py: using CellId 37217 00:14:47.292277 tst cs_paging_gprs_active.py: using BVCI 37218 00:14:47.400485 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:47.411191 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:47.421704 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:47.432044 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:47.442465 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:47.452714 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:47.463444 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:47.473786 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:47.484262 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:47.605290 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:47.721997 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:14:47.922787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:14:48.225870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17813): Launched 00:14:48.485956 run iperf3-srv_10.42.42.10(pid=17814): Launched 00:14:48.597752 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:14:48.798875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:14:49.098860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17815): Launched 00:14:49.359017 run iperf3-srv_10.42.42.10(pid=17816): Launched 00:14:49.470576 tst cs_paging_gprs_active.py:38: start network... 00:14:49.670718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:50.132800 run create_hlr_db(pid=17817): Launched 00:14:50.255336 bus /sierra_2: Setting Powered False 00:14:51.315216 run create_hlr_db(pid=17817): Terminated: ok {rc=0} 00:14:51.750474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17819): Launched 00:14:52.069337 run osmo-hlr_10.42.42.2(pid=17820): Launched 00:14:52.192089 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:52.741303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17822): Launched 00:14:53.060290 run osmo-stp_10.42.42.5(pid=17823): Launched 00:14:53.183587 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:14:53.735688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17825): Launched 00:14:53.858510 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:14:54.129370 run patchelf(pid=17826): Launched 00:14:54.307204 run osmo-stp_10.42.42.5(pid=17823): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17823)] 00:14:54.442671 run osmo-stp_10.42.42.5(pid=17823): stdout: | (launched: 2022-12-14_00:14:53.002176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:54.579620 run osmo-stp_10.42.42.5(pid=17823): stderr: | [0;m[38;5;43m20221214001453192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001453192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001453193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001453193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001453195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001453195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001453196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:54.717351 run osmo-stp_10.42.42.5(pid=17823): stdout: | (launched: 2022-12-14_00:14:53.002176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:54.848548 run osmo-stp_10.42.42.5(pid=17823): stderr: | [0;m[38;5;43m20221214001453192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001453192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001453193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001453193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001453195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001453195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001453196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:55.003938 run patchelf(pid=17826): Terminating (SIGINT) 00:14:55.183536 run patchelf(pid=17826): Terminated: ok {rc=0} 00:14:55.312793 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17823): Process ended prematurely: osmo-stp_10.42.42.5(pid=17823) [trial-2396↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17823)] [trial-2396↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 00:14:55.322889 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 00:14:55.351196 run osmo-hlr_10.42.42.2(pid=17820): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17820)] 00:14:55.401746 run osmo-hlr_10.42.42.2(pid=17820): stdout: | (launched: 2022-12-14_00:14:52.011328) 00:14:55.453654 run osmo-hlr_10.42.42.2(pid=17820): stderr: | [0;m[1;31m20221214001452210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001452210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001452210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001452210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001452210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001452210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001452223 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001452231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001452231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001452231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:55.506018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17813): Terminating (SIGTERM) 00:14:55.547985 run iperf3-srv_10.42.42.10(pid=17814): Terminating (SIGTERM) 00:14:55.589918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17815): Terminating (SIGTERM) 00:14:55.632534 run iperf3-srv_10.42.42.10(pid=17816): Terminating (SIGTERM) 00:14:55.674315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17819): Terminating (SIGTERM) 00:14:55.716745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17822): Terminating (SIGTERM) 00:14:55.759041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17825): Terminating (SIGTERM) 00:14:55.801164 --- ParallelTerminationStrategy: PID 17813 died... 00:14:55.821834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17813): Terminated: ok {rc=0} 00:14:55.868484 --- ParallelTerminationStrategy: PID 17814 died... 00:14:55.888349 run iperf3-srv_10.42.42.10(pid=17814): Terminated {rc=256} 00:14:55.934499 --- ParallelTerminationStrategy: PID 17815 died... 00:14:55.954443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17815): Terminated: ok {rc=0} 00:14:56.000578 --- ParallelTerminationStrategy: PID 17816 died... 00:14:56.020501 run iperf3-srv_10.42.42.10(pid=17816): Terminated {rc=256} 00:14:56.066726 --- ParallelTerminationStrategy: PID 17819 died... 00:14:56.086855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17819): Terminated: ok {rc=0} 00:14:56.133369 --- ParallelTerminationStrategy: PID 17822 died... 00:14:56.153207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17822): Terminated: ok {rc=0} 00:14:56.199317 --- ParallelTerminationStrategy: PID 17825 died... 00:14:56.219316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17825): Terminated: ok {rc=0} 00:14:56.306973 bus /gobi_0: Setting Powered False 00:14:57.405461 bus /gobi_0: Setting Powered False 00:14:58.520842 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 00:14:59.669108 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:59.680911 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:14:59.721066 tst iperf3.py: using LAC 37218 00:14:59.848338 tst iperf3.py: using RAC 243 00:14:59.970777 tst iperf3.py: using CellId 37218 00:15:00.094689 tst iperf3.py: using BVCI 37219 00:15:00.210900 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:00.222141 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:00.233129 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:00.244033 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:00.255166 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:00.266387 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:00.277905 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:00.289114 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:00.300411 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:00.418738 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:15:00.618115 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:00.941670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17827): Launched 00:15:01.242088 run iperf3-srv_10.42.42.10(pid=17828): Launched 00:15:01.366382 tst iperf3.py:8: start network... 00:15:01.570121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:02.053864 run create_hlr_db(pid=17832): Launched 00:15:02.209130 bus /gobi_6: Setting Powered False 00:15:03.268920 run create_hlr_db(pid=17832): Terminated: ok {rc=0} 00:15:03.684838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17834): Launched 00:15:03.983562 run osmo-hlr_10.42.42.2(pid=17835): Launched 00:15:04.096742 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:04.608497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17837): Launched 00:15:04.906198 run osmo-stp_10.42.42.5(pid=17838): Launched 00:15:05.019203 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:05.533972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17840): Launched 00:15:05.647900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:05.900916 run patchelf(pid=17841): Launched 00:15:06.066891 run osmo-stp_10.42.42.5(pid=17838): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17838)] 00:15:06.193501 run osmo-stp_10.42.42.5(pid=17838): stdout: | (launched: 2022-12-14_00:15:04.851444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:06.321706 run osmo-stp_10.42.42.5(pid=17838): stderr: | [0;m[38;5;43m20221214001505023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001505023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001505023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001505024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001505024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001505024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001505024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:06.449932 run osmo-stp_10.42.42.5(pid=17838): stdout: | (launched: 2022-12-14_00:15:04.851444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:06.573307 run osmo-stp_10.42.42.5(pid=17838): stderr: | [0;m[38;5;43m20221214001505023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001505023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001505023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001505024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001505024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001505024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001505024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:06.718166 run patchelf(pid=17841): Terminating (SIGINT) 00:15:06.887200 run patchelf(pid=17841): Terminated: ok {rc=0} 00:15:07.008165 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17838): Process ended prematurely: osmo-stp_10.42.42.5(pid=17838) [trial-2396↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17838)] [trial-2396↪gprs:nanobts+band-1900↪iperf3.py:8] 00:15:07.017695 tst iperf3.py:8: Test FAILED (7.4 sec) 00:15:07.044438 run osmo-hlr_10.42.42.2(pid=17835): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17835)] 00:15:07.092367 run osmo-hlr_10.42.42.2(pid=17835): stdout: | (launched: 2022-12-14_00:15:03.928454) 00:15:07.141522 run osmo-hlr_10.42.42.2(pid=17835): stderr: | [0;m[1;31m20221214001504106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001504106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001504106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001504106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001504106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001504106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001504126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001504136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001504136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001504136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:07.191004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17827): Terminating (SIGTERM) 00:15:07.230459 run iperf3-srv_10.42.42.10(pid=17828): Terminating (SIGTERM) 00:15:07.270211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17834): Terminating (SIGTERM) 00:15:07.309672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17837): Terminating (SIGTERM) 00:15:07.348883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17840): Terminating (SIGTERM) 00:15:07.388310 --- ParallelTerminationStrategy: PID 17827 died... 00:15:07.407038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17827): Terminated: ok {rc=0} 00:15:07.450690 --- ParallelTerminationStrategy: PID 17828 died... 00:15:07.469108 run iperf3-srv_10.42.42.10(pid=17828): Terminated {rc=256} 00:15:07.512652 --- ParallelTerminationStrategy: PID 17834 died... 00:15:07.531264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17834): Terminated: ok {rc=0} 00:15:07.574580 --- ParallelTerminationStrategy: PID 17837 died... 00:15:07.593202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17837): Terminated: ok {rc=0} 00:15:07.636559 --- ParallelTerminationStrategy: PID 17840 died... 00:15:07.654962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17840): Terminated: ok {rc=0} 00:15:07.739675 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 00:15:08.886364 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:08.897848 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:15:08.940475 tst iperf3m4.py: using LAC 37219 00:15:09.068060 tst iperf3m4.py: using RAC 244 00:15:09.193235 tst iperf3m4.py: using CellId 37219 00:15:09.318873 tst iperf3m4.py: using BVCI 37220 00:15:09.436569 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:09.447826 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:09.458913 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:09.470005 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:09.481326 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:09.492442 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:09.503903 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:09.515082 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:09.526648 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:09.644484 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:09.763738 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:09.879823 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:09.994171 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:15:10.196507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:10.498966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17842): Launched 00:15:10.759672 run iperf3-srv_10.42.42.10(pid=17843): Launched 00:15:10.872555 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:15:11.073020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:11.372252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17844): Launched 00:15:11.631871 run iperf3-srv_10.42.42.10(pid=17845): Launched 00:15:11.744067 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:15:11.944203 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:12.244035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17846): Launched 00:15:12.503261 run iperf3-srv_10.42.42.10(pid=17847): Launched 00:15:12.615256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:15:12.815155 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:13.116438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17848): Launched 00:15:13.376484 run iperf3-srv_10.42.42.10(pid=17849): Launched 00:15:13.488393 tst iperf3m4.py:8: start network... 00:15:13.687580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:14.149940 run create_hlr_db(pid=17850): Launched 00:15:14.271966 bus /gobi_6: Setting Powered False 00:15:15.332587 run create_hlr_db(pid=17850): Terminated: ok {rc=0} 00:15:15.749818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17853): Launched 00:15:16.061777 run osmo-hlr_10.42.42.2(pid=17854): Launched 00:15:16.303065 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:17.019601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17856): Launched 00:15:17.338537 run osmo-stp_10.42.42.5(pid=17857): Launched 00:15:17.453188 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:17.974766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17859): Launched 00:15:18.089392 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:18.343438 run patchelf(pid=17860): Launched 00:15:18.511982 run osmo-stp_10.42.42.5(pid=17857): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17857)] 00:15:18.638447 run osmo-stp_10.42.42.5(pid=17857): stdout: | (launched: 2022-12-14_00:15:17.276360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:18.766932 run osmo-stp_10.42.42.5(pid=17857): stderr: | [0;m[38;5;43m20221214001517451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001517451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001517452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001517452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001517452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001517453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001517453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:18.895858 run osmo-stp_10.42.42.5(pid=17857): stdout: | (launched: 2022-12-14_00:15:17.276360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:19.019176 run osmo-stp_10.42.42.5(pid=17857): stderr: | [0;m[38;5;43m20221214001517451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001517451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001517452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001517452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001517452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001517453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001517453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:19.164783 run patchelf(pid=17860): Terminating (SIGINT) 00:15:19.333558 run patchelf(pid=17860): Terminated: ok {rc=0} 00:15:19.454750 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17857): Process ended prematurely: osmo-stp_10.42.42.5(pid=17857) [trial-2396↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17857)] [trial-2396↪gprs:nanobts+band-1900↪iperf3m4.py:8] 00:15:19.463921 tst iperf3m4.py:8: Test FAILED (10.6 sec) 00:15:19.491010 run osmo-hlr_10.42.42.2(pid=17854): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17854)] 00:15:19.538739 run osmo-hlr_10.42.42.2(pid=17854): stdout: | (launched: 2022-12-14_00:15:15.996682) 00:15:19.587688 run osmo-hlr_10.42.42.2(pid=17854): stderr: | [0;m[1;31m20221214001516355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001516355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001516355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001516355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001516355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001516355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001516377 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001516393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001516393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001516393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:19.637002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17842): Terminating (SIGTERM) 00:15:19.676387 run iperf3-srv_10.42.42.10(pid=17843): Terminating (SIGTERM) 00:15:19.715628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17844): Terminating (SIGTERM) 00:15:19.755171 run iperf3-srv_10.42.42.10(pid=17845): Terminating (SIGTERM) 00:15:19.794528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17846): Terminating (SIGTERM) 00:15:19.834105 run iperf3-srv_10.42.42.10(pid=17847): Terminating (SIGTERM) 00:15:19.873336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17848): Terminating (SIGTERM) 00:15:19.913286 run iperf3-srv_10.42.42.10(pid=17849): Terminating (SIGTERM) 00:15:19.952486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17853): Terminating (SIGTERM) 00:15:19.991816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17856): Terminating (SIGTERM) 00:15:20.031143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17859): Terminating (SIGTERM) 00:15:20.070718 --- ParallelTerminationStrategy: PID 17842 died... 00:15:20.090106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17842): Terminated: ok {rc=0} 00:15:20.134066 --- ParallelTerminationStrategy: PID 17843 died... 00:15:20.152651 run iperf3-srv_10.42.42.10(pid=17843): Terminated {rc=256} 00:15:20.196452 --- ParallelTerminationStrategy: PID 17844 died... 00:15:20.214952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17844): Terminated: ok {rc=0} 00:15:20.259000 --- ParallelTerminationStrategy: PID 17845 died... 00:15:20.277764 run iperf3-srv_10.42.42.10(pid=17845): Terminated {rc=256} 00:15:20.321290 --- ParallelTerminationStrategy: PID 17846 died... 00:15:20.339954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17846): Terminated: ok {rc=0} 00:15:20.383575 --- ParallelTerminationStrategy: PID 17847 died... 00:15:20.402318 run iperf3-srv_10.42.42.10(pid=17847): Terminated {rc=256} 00:15:20.445796 --- ParallelTerminationStrategy: PID 17848 died... 00:15:20.464518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17848): Terminated: ok {rc=0} 00:15:20.508149 --- ParallelTerminationStrategy: PID 17849 died... 00:15:20.526945 run iperf3-srv_10.42.42.10(pid=17849): Terminated {rc=256} 00:15:20.570512 --- ParallelTerminationStrategy: PID 17853 died... 00:15:20.589167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17853): Terminated: ok {rc=0} 00:15:20.632726 --- ParallelTerminationStrategy: PID 17856 died... 00:15:20.651386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17856): Terminated: ok {rc=0} 00:15:20.694959 --- ParallelTerminationStrategy: PID 17859 died... 00:15:20.713642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17859): Terminated: ok {rc=0} 00:15:20.798746 bus /gobi_4: Setting Powered False 00:15:21.898620 bus /gobi_4: Setting Powered False 00:15:23.013500 bus /gobi_1: Setting Powered False 00:15:24.114731 bus /gobi_1: Setting Powered False 00:15:25.232989 bus /gobi_0: Setting Powered False 00:15:26.331833 bus /gobi_0: Setting Powered False 00:15:27.447733 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 00:15:28.550512 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:28.561813 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:15:28.602695 tst ping.py: using LAC 37220 00:15:28.719882 tst ping.py: using RAC 245 00:15:28.839127 tst ping.py: using CellId 37220 00:15:28.953526 tst ping.py: using BVCI 37221 00:15:29.060267 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:29.071212 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:29.081817 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:29.092410 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:29.103096 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:29.113783 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:29.124458 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:29.135200 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:29.252526 tst ping.py:19: start network... 00:15:29.464305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:29.948677 run create_hlr_db(pid=17861): Launched 00:15:30.068868 bus /gobi_6: Setting Powered False 00:15:31.147954 run create_hlr_db(pid=17861): Terminated: ok {rc=0} 00:15:31.696788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17863): Launched 00:15:32.059483 run osmo-hlr_10.42.42.2(pid=17864): Launched 00:15:32.307351 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:32.851623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17866): Launched 00:15:33.165697 run osmo-stp_10.42.42.5(pid=17867): Launched 00:15:33.286161 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:33.828745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17869): Launched 00:15:33.949016 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:34.214491 run patchelf(pid=17870): Launched 00:15:34.388739 run osmo-stp_10.42.42.5(pid=17867): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17867)] 00:15:34.521303 run osmo-stp_10.42.42.5(pid=17867): stdout: | (launched: 2022-12-14_00:15:33.108027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:34.655159 run osmo-stp_10.42.42.5(pid=17867): stderr: | [0;m[38;5;43m20221214001533299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001533299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001533300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001533300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001533301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001533301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001533301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:34.789403 run osmo-stp_10.42.42.5(pid=17867): stdout: | (launched: 2022-12-14_00:15:33.108027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:34.917985 run osmo-stp_10.42.42.5(pid=17867): stderr: | [0;m[38;5;43m20221214001533299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001533299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001533300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001533300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001533301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001533301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001533301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:35.070716 run patchelf(pid=17870): Terminating (SIGINT) 00:15:35.247449 run patchelf(pid=17870): Terminated: ok {rc=0} 00:15:35.373984 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17867): Process ended prematurely: osmo-stp_10.42.42.5(pid=17867) [trial-2396↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17867)] [trial-2396↪gprs:nanobts+band-1900↪ping.py:22] 00:15:35.383504 tst ping.py:22: Test FAILED (6.8 sec) 00:15:35.411426 run osmo-hlr_10.42.42.2(pid=17864): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17864)] 00:15:35.461674 run osmo-hlr_10.42.42.2(pid=17864): stdout: | (launched: 2022-12-14_00:15:32.003261) 00:15:35.513274 run osmo-hlr_10.42.42.2(pid=17864): stderr: | [0;m[1;31m20221214001532264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001532264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001532264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001532264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001532264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001532264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001532285 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001532302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001532302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001532302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:35.564891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17863): Terminating (SIGTERM) 00:15:35.606354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17866): Terminating (SIGTERM) 00:15:35.647932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17869): Terminating (SIGTERM) 00:15:35.689581 --- ParallelTerminationStrategy: PID 17863 died... 00:15:35.709745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17863): Terminated: ok {rc=0} 00:15:35.755623 --- ParallelTerminationStrategy: PID 17866 died... 00:15:35.775260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17866): Terminated: ok {rc=0} 00:15:35.820851 --- ParallelTerminationStrategy: PID 17869 died... 00:15:35.841009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17869): Terminated: ok {rc=0} 00:15:35.927252 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 00:15:37.012028 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:37.023932 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:15:37.063229 tst ping_idle_ping.py: using LAC 37221 00:15:37.188350 tst ping_idle_ping.py: using RAC 246 00:15:37.310852 tst ping_idle_ping.py: using CellId 37221 00:15:37.434475 tst ping_idle_ping.py: using BVCI 37222 00:15:37.548238 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:37.559470 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:37.570625 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:37.581687 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:37.592935 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:37.604223 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:37.615630 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:37.627090 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:37.746532 tst ping_idle_ping.py:24: start network... 00:15:37.958367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:38.448091 run create_hlr_db(pid=17871): Launched 00:15:38.567247 bus /gobi_6: Setting Powered False 00:15:39.629759 run create_hlr_db(pid=17871): Terminated: ok {rc=0} 00:15:40.050494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17873): Launched 00:15:40.345727 run osmo-hlr_10.42.42.2(pid=17874): Launched 00:15:40.457650 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:40.963950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17876): Launched 00:15:41.258227 run osmo-stp_10.42.42.5(pid=17877): Launched 00:15:41.369933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:41.878631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17879): Launched 00:15:41.990690 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:42.239227 run patchelf(pid=17880): Launched 00:15:42.402938 run osmo-stp_10.42.42.5(pid=17877): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17877)] 00:15:42.527194 run osmo-stp_10.42.42.5(pid=17877): stdout: | (launched: 2022-12-14_00:15:41.204154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:42.653151 run osmo-stp_10.42.42.5(pid=17877): stderr: | [0;m[38;5;43m20221214001541373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001541373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001541374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001541374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001541374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001541374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001541375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:42.779003 run osmo-stp_10.42.42.5(pid=17877): stdout: | (launched: 2022-12-14_00:15:41.204154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:42.899655 run osmo-stp_10.42.42.5(pid=17877): stderr: | [0;m[38;5;43m20221214001541373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001541373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001541374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001541374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001541374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001541374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001541375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:43.042612 run patchelf(pid=17880): Terminating (SIGINT) 00:15:43.208154 run patchelf(pid=17880): Terminated: ok {rc=0} 00:15:43.326766 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17877): Process ended prematurely: osmo-stp_10.42.42.5(pid=17877) [trial-2396↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17877)] [trial-2396↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 00:15:43.335525 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 00:15:43.362047 run osmo-hlr_10.42.42.2(pid=17874): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17874)] 00:15:43.410090 run osmo-hlr_10.42.42.2(pid=17874): stdout: | (launched: 2022-12-14_00:15:40.291517) 00:15:43.458883 run osmo-hlr_10.42.42.2(pid=17874): stderr: | [0;m[1;31m20221214001540466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001540466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001540466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001540466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001540466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001540466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001540478 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001540487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001540487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001540487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:43.507839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17873): Terminating (SIGTERM) 00:15:43.546815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17876): Terminating (SIGTERM) 00:15:43.585640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17879): Terminating (SIGTERM) 00:15:43.625071 --- ParallelTerminationStrategy: PID 17873 died... 00:15:43.643961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17873): Terminated: ok {rc=0} 00:15:43.687202 --- ParallelTerminationStrategy: PID 17876 died... 00:15:43.705632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17876): Terminated: ok {rc=0} 00:15:43.748697 --- ParallelTerminationStrategy: PID 17879 died... 00:15:43.767196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17879): Terminated: ok {rc=0} 00:15:43.849473 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 00:15:45.142378 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:15:45.148346 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:15:45.171684 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:15:45.209918 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:15:45.295073 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:15:45.318547 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:15:45.356196 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:15:45.969483 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:15:46.026561 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:46.038987 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:15:46.088664 tst cs_paging_gprs_active.py: using LAC 37222 00:15:46.240420 tst cs_paging_gprs_active.py: using RAC 247 00:15:46.365234 tst cs_paging_gprs_active.py: using CellId 37222 00:15:46.490719 tst cs_paging_gprs_active.py: using BVCI 37223 00:15:46.611286 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:46.623445 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:46.635199 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:46.648066 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:46.660790 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:46.673798 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:46.686681 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:46.699161 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:46.712001 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:15:46.840478 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:15:46.983303 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:15:47.266793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:47.569798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17885): Launched 00:15:47.829643 run iperf3-srv_10.42.42.10(pid=17886): Launched 00:15:47.941658 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:15:48.142122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:48.442212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17887): Launched 00:15:48.702660 run iperf3-srv_10.42.42.10(pid=17888): Launched 00:15:48.814943 tst cs_paging_gprs_active.py:38: start network... 00:15:49.015514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:49.479260 run create_hlr_db(pid=17889): Launched 00:15:49.600503 bus /gobi_6: Setting Powered False 00:15:50.660643 run create_hlr_db(pid=17889): Terminated: ok {rc=0} 00:15:51.077285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17891): Launched 00:15:51.376385 run osmo-hlr_10.42.42.2(pid=17892): Launched 00:15:51.489015 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:52.031176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17896): Launched 00:15:52.348734 run osmo-stp_10.42.42.5(pid=17897): Launched 00:15:52.462497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:52.979663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17899): Launched 00:15:53.094074 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:53.348380 run patchelf(pid=17900): Launched 00:15:53.514774 run osmo-stp_10.42.42.5(pid=17897): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17897)] 00:15:53.641166 run osmo-stp_10.42.42.5(pid=17897): stdout: | (launched: 2022-12-14_00:15:52.293868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:53.769650 run osmo-stp_10.42.42.5(pid=17897): stderr: | [0;m[38;5;43m20221214001552465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001552466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001552466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001552466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001552467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001552467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001552467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:53.898064 run osmo-stp_10.42.42.5(pid=17897): stdout: | (launched: 2022-12-14_00:15:52.293868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:54.020785 run osmo-stp_10.42.42.5(pid=17897): stderr: | [0;m[38;5;43m20221214001552465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001552466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001552466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001552466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001552467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001552467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001552467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:54.166393 run patchelf(pid=17900): Terminating (SIGINT) 00:15:54.333956 run patchelf(pid=17900): Terminated: ok {rc=0} 00:15:54.454890 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17897): Process ended prematurely: osmo-stp_10.42.42.5(pid=17897) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17897)] [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:15:54.464231 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 00:15:54.491208 run osmo-hlr_10.42.42.2(pid=17892): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17892)] 00:15:54.538370 run osmo-hlr_10.42.42.2(pid=17892): stdout: | (launched: 2022-12-14_00:15:51.321612) 00:15:54.587611 run osmo-hlr_10.42.42.2(pid=17892): stderr: | [0;m[1;31m20221214001551498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001551498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001551498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001551498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001551498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001551498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001551510 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001551521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001551522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001551522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:54.636879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17885): Terminating (SIGTERM) 00:15:54.676134 run iperf3-srv_10.42.42.10(pid=17886): Terminating (SIGTERM) 00:15:54.715206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17887): Terminating (SIGTERM) 00:15:54.754435 run iperf3-srv_10.42.42.10(pid=17888): Terminating (SIGTERM) 00:15:54.793513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17891): Terminating (SIGTERM) 00:15:54.832881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17896): Terminating (SIGTERM) 00:15:54.872000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17899): Terminating (SIGTERM) 00:15:54.911347 --- ParallelTerminationStrategy: PID 17885 died... 00:15:54.930383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17885): Terminated: ok {rc=0} 00:15:54.973992 --- ParallelTerminationStrategy: PID 17886 died... 00:15:54.992350 run iperf3-srv_10.42.42.10(pid=17886): Terminated {rc=256} 00:15:55.035475 --- ParallelTerminationStrategy: PID 17887 died... 00:15:55.053967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17887): Terminated: ok {rc=0} 00:15:55.097165 --- ParallelTerminationStrategy: PID 17888 died... 00:15:55.115364 run iperf3-srv_10.42.42.10(pid=17888): Terminated {rc=256} 00:15:55.158559 --- ParallelTerminationStrategy: PID 17891 died... 00:15:55.176935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17891): Terminated: ok {rc=0} 00:15:55.220493 --- ParallelTerminationStrategy: PID 17896 died... 00:15:55.239148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17896): Terminated: ok {rc=0} 00:15:55.282477 --- ParallelTerminationStrategy: PID 17899 died... 00:15:55.300869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17899): Terminated: ok {rc=0} 00:15:55.385124 bus /gobi_0: Setting Powered False 00:15:56.484379 bus /gobi_0: Setting Powered False 00:15:57.599315 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:15:58.747675 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:58.759739 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:15:58.804456 tst iperf3.py: using LAC 37223 00:15:58.931646 tst iperf3.py: using RAC 248 00:15:59.056651 tst iperf3.py: using CellId 37223 00:15:59.182094 tst iperf3.py: using BVCI 37224 00:15:59.300251 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:59.312152 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:59.323465 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:59.334657 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:59.346131 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:59.357520 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:59.369141 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:59.380550 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:59.392133 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:15:59.509252 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:15:59.724396 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:00.043085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17901): Launched 00:16:00.320815 run iperf3-srv_10.42.42.10(pid=17902): Launched 00:16:00.440923 tst iperf3.py:8: start network... 00:16:00.657428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:01.165652 run create_hlr_db(pid=17903): Launched 00:16:01.326014 bus /gobi_6: Setting Powered False 00:16:02.385979 run create_hlr_db(pid=17903): Terminated: ok {rc=0} 00:16:02.803699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17905): Launched 00:16:03.102586 run osmo-hlr_10.42.42.2(pid=17906): Launched 00:16:03.216283 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:03.733541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17908): Launched 00:16:04.033054 run osmo-stp_10.42.42.5(pid=17909): Launched 00:16:04.146966 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:04.662624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17911): Launched 00:16:04.777223 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:05.030821 run patchelf(pid=17912): Launched 00:16:05.197515 run osmo-stp_10.42.42.5(pid=17909): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17909)] 00:16:05.325136 run osmo-stp_10.42.42.5(pid=17909): stdout: | (launched: 2022-12-14_00:16:03.977792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:05.454026 run osmo-stp_10.42.42.5(pid=17909): stderr: | [0;m[38;5;43m20221214001604148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001604148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001604148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001604149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001604151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001604151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001604151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:05.583684 run osmo-stp_10.42.42.5(pid=17909): stdout: | (launched: 2022-12-14_00:16:03.977792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:05.706347 run osmo-stp_10.42.42.5(pid=17909): stderr: | [0;m[38;5;43m20221214001604148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001604148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001604148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001604149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001604151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001604151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001604151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:05.851506 run patchelf(pid=17912): Terminating (SIGINT) 00:16:06.019843 run patchelf(pid=17912): Terminated: ok {rc=0} 00:16:06.140901 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17909): Process ended prematurely: osmo-stp_10.42.42.5(pid=17909) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17909)] [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 00:16:06.150352 tst iperf3.py:8: Test FAILED (7.4 sec) 00:16:06.177645 run osmo-hlr_10.42.42.2(pid=17906): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17906)] 00:16:06.225402 run osmo-hlr_10.42.42.2(pid=17906): stdout: | (launched: 2022-12-14_00:16:03.047600) 00:16:06.275018 run osmo-hlr_10.42.42.2(pid=17906): stderr: | [0;m[1;31m20221214001603224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001603224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001603224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001603224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001603224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001603224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001603237 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001603248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001603249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001603249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:06.325235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17901): Terminating (SIGTERM) 00:16:06.365081 run iperf3-srv_10.42.42.10(pid=17902): Terminating (SIGTERM) 00:16:06.404693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17905): Terminating (SIGTERM) 00:16:06.444357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17908): Terminating (SIGTERM) 00:16:06.483991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17911): Terminating (SIGTERM) 00:16:06.524016 --- ParallelTerminationStrategy: PID 17901 died... 00:16:06.543257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17901): Terminated: ok {rc=0} 00:16:06.587559 --- ParallelTerminationStrategy: PID 17902 died... 00:16:06.606376 run iperf3-srv_10.42.42.10(pid=17902): Terminated {rc=256} 00:16:06.650046 --- ParallelTerminationStrategy: PID 17905 died... 00:16:06.668368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17905): Terminated: ok {rc=0} 00:16:06.711952 --- ParallelTerminationStrategy: PID 17908 died... 00:16:06.730522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17908): Terminated: ok {rc=0} 00:16:06.774021 --- ParallelTerminationStrategy: PID 17911 died... 00:16:06.792612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17911): Terminated: ok {rc=0} 00:16:06.875274 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:16:08.017514 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:08.029081 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:16:08.073208 tst iperf3m4.py: using LAC 37224 00:16:08.199384 tst iperf3m4.py: using RAC 249 00:16:08.323159 tst iperf3m4.py: using CellId 37224 00:16:08.448833 tst iperf3m4.py: using BVCI 37225 00:16:08.558827 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:08.570180 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:08.581222 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:08.592228 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:08.603357 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:08.614680 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:08.626101 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:08.637182 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:08.648388 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:08.762941 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:08.884802 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:09.002672 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:09.119180 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:16:09.322188 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:09.624780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17913): Launched 00:16:09.887165 run iperf3-srv_10.42.42.10(pid=17914): Launched 00:16:09.999579 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:16:10.200860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:10.501344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17915): Launched 00:16:10.761835 run iperf3-srv_10.42.42.10(pid=17916): Launched 00:16:10.874072 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:16:11.075230 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:11.377084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17917): Launched 00:16:11.637820 run iperf3-srv_10.42.42.10(pid=17918): Launched 00:16:11.750333 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:16:11.952051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:12.253472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17919): Launched 00:16:12.514152 run iperf3-srv_10.42.42.10(pid=17920): Launched 00:16:12.626247 tst iperf3m4.py:8: start network... 00:16:12.827187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:13.291010 run create_hlr_db(pid=17921): Launched 00:16:13.413861 bus /gobi_6: Setting Powered False 00:16:14.474331 run create_hlr_db(pid=17921): Terminated: ok {rc=0} 00:16:14.912208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17923): Launched 00:16:15.233541 run osmo-hlr_10.42.42.2(pid=17924): Launched 00:16:15.356041 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:15.931536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17926): Launched 00:16:16.336864 run osmo-stp_10.42.42.5(pid=17927): Launched 00:16:16.572237 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:17.275348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17929): Launched 00:16:17.390270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:17.643905 run patchelf(pid=17930): Launched 00:16:17.810520 run osmo-stp_10.42.42.5(pid=17927): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17927)] 00:16:17.936939 run osmo-stp_10.42.42.5(pid=17927): stdout: | (launched: 2022-12-14_00:16:16.272811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:18.064870 run osmo-stp_10.42.42.5(pid=17927): stderr: | [0;m[38;5;43m20221214001616614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001616614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001616614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001616615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001616615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001616615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001616615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:18.193471 run osmo-stp_10.42.42.5(pid=17927): stdout: | (launched: 2022-12-14_00:16:16.272811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:18.316242 run osmo-stp_10.42.42.5(pid=17927): stderr: | [0;m[38;5;43m20221214001616614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001616614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001616614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001616615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001616615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001616615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001616615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:18.461370 run patchelf(pid=17930): Terminating (SIGINT) 00:16:18.629821 run patchelf(pid=17930): Terminated: ok {rc=0} 00:16:18.750745 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17927): Process ended prematurely: osmo-stp_10.42.42.5(pid=17927) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17927)] [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 00:16:18.760068 tst iperf3m4.py:8: Test FAILED (10.8 sec) 00:16:18.787311 run osmo-hlr_10.42.42.2(pid=17924): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17924)] 00:16:18.834339 run osmo-hlr_10.42.42.2(pid=17924): stdout: | (launched: 2022-12-14_00:16:15.174789) 00:16:18.882901 run osmo-hlr_10.42.42.2(pid=17924): stderr: | [0;m[1;31m20221214001615375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001615375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001615375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001615375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001615375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001615375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001615387 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001615395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001615395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001615395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:18.931969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17913): Terminating (SIGTERM) 00:16:18.971208 run iperf3-srv_10.42.42.10(pid=17914): Terminating (SIGTERM) 00:16:19.010247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17915): Terminating (SIGTERM) 00:16:19.049371 run iperf3-srv_10.42.42.10(pid=17916): Terminating (SIGTERM) 00:16:19.088479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17917): Terminating (SIGTERM) 00:16:19.127622 run iperf3-srv_10.42.42.10(pid=17918): Terminating (SIGTERM) 00:16:19.166574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17919): Terminating (SIGTERM) 00:16:19.205668 run iperf3-srv_10.42.42.10(pid=17920): Terminating (SIGTERM) 00:16:19.244589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17923): Terminating (SIGTERM) 00:16:19.283610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17926): Terminating (SIGTERM) 00:16:19.323257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17929): Terminating (SIGTERM) 00:16:19.362870 --- ParallelTerminationStrategy: PID 17913 died... 00:16:19.381893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17913): Terminated: ok {rc=0} 00:16:19.425625 --- ParallelTerminationStrategy: PID 17914 died... 00:16:19.443877 run iperf3-srv_10.42.42.10(pid=17914): Terminated {rc=256} 00:16:19.486908 --- ParallelTerminationStrategy: PID 17915 died... 00:16:19.505311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17915): Terminated: ok {rc=0} 00:16:19.548746 --- ParallelTerminationStrategy: PID 17916 died... 00:16:19.567246 run iperf3-srv_10.42.42.10(pid=17916): Terminated {rc=256} 00:16:19.610345 --- ParallelTerminationStrategy: PID 17917 died... 00:16:19.628696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17917): Terminated: ok {rc=0} 00:16:19.671977 --- ParallelTerminationStrategy: PID 17918 died... 00:16:19.690442 run iperf3-srv_10.42.42.10(pid=17918): Terminated {rc=256} 00:16:19.733533 --- ParallelTerminationStrategy: PID 17919 died... 00:16:19.751789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17919): Terminated: ok {rc=0} 00:16:19.795567 --- ParallelTerminationStrategy: PID 17920 died... 00:16:19.814152 run iperf3-srv_10.42.42.10(pid=17920): Terminated {rc=256} 00:16:19.857296 --- ParallelTerminationStrategy: PID 17923 died... 00:16:19.875520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17923): Terminated: ok {rc=0} 00:16:19.918836 --- ParallelTerminationStrategy: PID 17926 died... 00:16:19.937212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17926): Terminated: ok {rc=0} 00:16:19.980429 --- ParallelTerminationStrategy: PID 17929 died... 00:16:19.999142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17929): Terminated: ok {rc=0} 00:16:20.084164 bus /gobi_4: Setting Powered False 00:16:21.184279 bus /gobi_4: Setting Powered False 00:16:22.296459 bus /gobi_1: Setting Powered False 00:16:23.394453 bus /gobi_1: Setting Powered False 00:16:24.510298 bus /gobi_0: Setting Powered False 00:16:25.608354 bus /gobi_0: Setting Powered False 00:16:26.726450 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 00:16:27.829177 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:27.841090 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:16:27.883521 tst ping.py: using LAC 37225 00:16:28.007278 tst ping.py: using RAC 250 00:16:28.129965 tst ping.py: using CellId 37225 00:16:28.252826 tst ping.py: using BVCI 37226 00:16:28.366760 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:28.378078 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:28.389395 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:28.400594 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:28.412027 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:28.423422 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:28.435223 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:28.446739 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:28.561548 tst ping.py:19: start network... 00:16:28.769933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:29.256168 run create_hlr_db(pid=17931): Launched 00:16:29.375892 bus /gobi_6: Setting Powered False 00:16:30.438860 run create_hlr_db(pid=17931): Terminated: ok {rc=0} 00:16:30.868688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17933): Launched 00:16:31.213747 run osmo-hlr_10.42.42.2(pid=17934): Launched 00:16:31.440747 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:32.097338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17936): Launched 00:16:32.405135 run osmo-stp_10.42.42.5(pid=17937): Launched 00:16:32.517493 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:33.025927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17939): Launched 00:16:33.138095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:33.385795 run patchelf(pid=17940): Launched 00:16:33.549411 run osmo-stp_10.42.42.5(pid=17937): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17937)] 00:16:33.673826 run osmo-stp_10.42.42.5(pid=17937): stdout: | (launched: 2022-12-14_00:16:32.350937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:33.799188 run osmo-stp_10.42.42.5(pid=17937): stderr: | [0;m[38;5;43m20221214001632518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001632518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001632519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001632519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001632519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001632519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001632520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:33.925417 run osmo-stp_10.42.42.5(pid=17937): stdout: | (launched: 2022-12-14_00:16:32.350937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:34.045311 run osmo-stp_10.42.42.5(pid=17937): stderr: | [0;m[38;5;43m20221214001632518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001632518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001632519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001632519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001632519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001632519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001632520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:34.187576 run patchelf(pid=17940): Terminating (SIGINT) 00:16:34.352016 run patchelf(pid=17940): Terminated: ok {rc=0} 00:16:34.470362 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17937): Process ended prematurely: osmo-stp_10.42.42.5(pid=17937) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17937)] [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 00:16:34.479068 tst ping.py:22: Test FAILED (6.6 sec) 00:16:34.505480 run osmo-hlr_10.42.42.2(pid=17934): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17934)] 00:16:34.552901 run osmo-hlr_10.42.42.2(pid=17934): stdout: | (launched: 2022-12-14_00:16:31.143969) 00:16:34.601737 run osmo-hlr_10.42.42.2(pid=17934): stderr: | [0;m[1;31m20221214001631484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001631484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001631484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001631484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001631484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001631485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001631503 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001631519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001631519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001631519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:34.650711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17933): Terminating (SIGTERM) 00:16:34.689910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17936): Terminating (SIGTERM) 00:16:34.728805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17939): Terminating (SIGTERM) 00:16:34.768093 --- ParallelTerminationStrategy: PID 17933 died... 00:16:34.787135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17933): Terminated: ok {rc=0} 00:16:34.830943 --- ParallelTerminationStrategy: PID 17936 died... 00:16:34.849633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17936): Terminated: ok {rc=0} 00:16:34.893124 --- ParallelTerminationStrategy: PID 17939 died... 00:16:34.911480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17939): Terminated: ok {rc=0} 00:16:34.996318 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:16:36.083492 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:36.095165 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:16:36.137191 tst ping_idle_ping.py: using LAC 37226 00:16:36.253406 tst ping_idle_ping.py: using RAC 251 00:16:36.368473 tst ping_idle_ping.py: using CellId 37226 00:16:36.487068 tst ping_idle_ping.py: using BVCI 37227 00:16:36.595148 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:36.606296 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:36.617175 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:36.627864 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:36.638582 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:36.649523 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:36.661176 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:36.672004 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:36.786663 tst ping_idle_ping.py:24: start network... 00:16:36.983441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:37.445998 run create_hlr_db(pid=17941): Launched 00:16:37.566052 bus /gobi_6: Setting Powered False 00:16:38.626135 run create_hlr_db(pid=17941): Terminated: ok {rc=0} 00:16:39.037910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17943): Launched 00:16:39.332160 run osmo-hlr_10.42.42.2(pid=17944): Launched 00:16:39.443433 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:39.948406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17946): Launched 00:16:40.264596 run osmo-stp_10.42.42.5(pid=17947): Launched 00:16:40.386266 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:40.932686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17949): Launched 00:16:41.053415 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:41.321256 run patchelf(pid=17950): Launched 00:16:41.496516 run osmo-stp_10.42.42.5(pid=17947): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17947)] 00:16:41.630464 run osmo-stp_10.42.42.5(pid=17947): stdout: | (launched: 2022-12-14_00:16:40.207175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:41.766023 run osmo-stp_10.42.42.5(pid=17947): stderr: | [0;m[38;5;43m20221214001640398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001640399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001640399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001640399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001640402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001640402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001640402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:41.901378 run osmo-stp_10.42.42.5(pid=17947): stdout: | (launched: 2022-12-14_00:16:40.207175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:42.031234 run osmo-stp_10.42.42.5(pid=17947): stderr: | [0;m[38;5;43m20221214001640398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001640399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001640399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001640399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001640402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001640402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001640402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:42.185109 run patchelf(pid=17950): Terminating (SIGINT) 00:16:42.362888 run patchelf(pid=17950): Terminated: ok {rc=0} 00:16:42.490269 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17947): Process ended prematurely: osmo-stp_10.42.42.5(pid=17947) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17947)] [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 00:16:42.499654 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:16:42.527595 run osmo-hlr_10.42.42.2(pid=17944): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17944)] 00:16:42.577809 run osmo-hlr_10.42.42.2(pid=17944): stdout: | (launched: 2022-12-14_00:16:39.278053) 00:16:42.629326 run osmo-hlr_10.42.42.2(pid=17944): stderr: | [0;m[1;31m20221214001639453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001639453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001639453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001639453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001639453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001639453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001639466 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001639474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001639474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001639474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:42.681129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17943): Terminating (SIGTERM) 00:16:42.722341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17946): Terminating (SIGTERM) 00:16:42.763789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17949): Terminating (SIGTERM) 00:16:42.805511 --- ParallelTerminationStrategy: PID 17943 died... 00:16:42.825678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17943): Terminated: ok {rc=0} 00:16:42.871624 --- ParallelTerminationStrategy: PID 17946 died... 00:16:42.891390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17946): Terminated: ok {rc=0} 00:16:42.937478 --- ParallelTerminationStrategy: PID 17949 died... 00:16:42.957279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17949): Terminated: ok {rc=0} 00:16:43.044304 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:16:44.335200 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:16:44.345095 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:16:44.369367 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:16:44.411056 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:16:44.500325 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:16:44.524562 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:16:44.564464 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:16:45.162964 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:16:45.216278 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:45.227717 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:16:45.289284 tst cs_paging_gprs_active.py: using LAC 37227 00:16:45.416173 tst cs_paging_gprs_active.py: using RAC 252 00:16:45.540923 tst cs_paging_gprs_active.py: using CellId 37227 00:16:45.666787 tst cs_paging_gprs_active.py: using BVCI 37228 00:16:45.784881 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:45.796424 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:45.807624 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:45.818908 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:45.834646 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:45.848535 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:45.864596 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:45.876439 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:45.889293 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:16:46.022342 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:16:46.143424 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:16:46.363873 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:46.692571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17954): Launched 00:16:46.997707 run iperf3-srv_10.42.42.10(pid=17955): Launched 00:16:47.122783 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:16:47.340759 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:47.662348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17956): Launched 00:16:47.940449 run iperf3-srv_10.42.42.10(pid=17957): Launched 00:16:48.060319 tst cs_paging_gprs_active.py:38: start network... 00:16:48.276704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:48.772874 run create_hlr_db(pid=17958): Launched 00:16:48.894725 bus /gobi_6: Setting Powered False 00:16:49.959260 run create_hlr_db(pid=17958): Terminated: ok {rc=0} 00:16:50.387267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17960): Launched 00:16:50.687986 run osmo-hlr_10.42.42.2(pid=17961): Launched 00:16:50.802549 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:51.330210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17963): Launched 00:16:51.629165 run osmo-stp_10.42.42.5(pid=17964): Launched 00:16:51.756496 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:52.311338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17966): Launched 00:16:52.434938 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:52.705148 run patchelf(pid=17967): Launched 00:16:52.882589 run osmo-stp_10.42.42.5(pid=17964): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17964)] 00:16:53.017809 run osmo-stp_10.42.42.5(pid=17964): stdout: | (launched: 2022-12-14_00:16:51.574115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:53.155392 run osmo-stp_10.42.42.5(pid=17964): stderr: | [0;m[38;5;43m20221214001651761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001651761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001651761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001651762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001651762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001651762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001651762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:53.293220 run osmo-stp_10.42.42.5(pid=17964): stdout: | (launched: 2022-12-14_00:16:51.574115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:53.424143 run osmo-stp_10.42.42.5(pid=17964): stderr: | [0;m[38;5;43m20221214001651761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001651761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001651761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001651762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001651762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001651762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001651762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:53.579325 run patchelf(pid=17967): Terminating (SIGINT) 00:16:53.758762 run patchelf(pid=17967): Terminated: ok {rc=0} 00:16:53.887813 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17964): Process ended prematurely: osmo-stp_10.42.42.5(pid=17964) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17964)] [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:16:53.897872 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 00:16:53.926200 run osmo-hlr_10.42.42.2(pid=17961): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17961)] 00:16:53.976405 run osmo-hlr_10.42.42.2(pid=17961): stdout: | (launched: 2022-12-14_00:16:50.633351) 00:16:54.028078 run osmo-hlr_10.42.42.2(pid=17961): stderr: | [0;m[1;31m20221214001650809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001650809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001650809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001650809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001650809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001650810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001650821 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001650830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001650831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001650831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:54.080141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17954): Terminating (SIGTERM) 00:16:54.121817 run iperf3-srv_10.42.42.10(pid=17955): Terminating (SIGTERM) 00:16:54.163302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17956): Terminating (SIGTERM) 00:16:54.205712 run iperf3-srv_10.42.42.10(pid=17957): Terminating (SIGTERM) 00:16:54.247833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17960): Terminating (SIGTERM) 00:16:54.289837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17963): Terminating (SIGTERM) 00:16:54.331889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17966): Terminating (SIGTERM) 00:16:54.374358 --- ParallelTerminationStrategy: PID 17954 died... 00:16:54.394901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17954): Terminated: ok {rc=0} 00:16:54.441212 --- ParallelTerminationStrategy: PID 17955 died... 00:16:54.460872 run iperf3-srv_10.42.42.10(pid=17955): Terminated {rc=256} 00:16:54.506713 --- ParallelTerminationStrategy: PID 17956 died... 00:16:54.526360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17956): Terminated: ok {rc=0} 00:16:54.571861 --- ParallelTerminationStrategy: PID 17957 died... 00:16:54.591467 run iperf3-srv_10.42.42.10(pid=17957): Terminated {rc=256} 00:16:54.637107 --- ParallelTerminationStrategy: PID 17960 died... 00:16:54.656698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17960): Terminated: ok {rc=0} 00:16:54.702229 --- ParallelTerminationStrategy: PID 17963 died... 00:16:54.721941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17963): Terminated: ok {rc=0} 00:16:54.767680 --- ParallelTerminationStrategy: PID 17966 died... 00:16:54.787416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17966): Terminated: ok {rc=0} 00:16:54.874903 bus /gobi_0: Setting Powered False 00:16:55.972282 bus /gobi_0: Setting Powered False 00:16:57.087423 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:16:58.235730 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:58.247821 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:16:58.311472 tst iperf3.py: using LAC 37228 00:16:58.434793 tst iperf3.py: using RAC 253 00:16:58.558623 tst iperf3.py: using CellId 37228 00:16:58.684214 tst iperf3.py: using BVCI 37229 00:16:58.801087 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:58.812485 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:58.823795 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:58.835062 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:58.846677 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:58.858208 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:58.869851 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:58.881252 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:58.892938 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:16:59.008434 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:16:59.210664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:59.510290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17968): Launched 00:16:59.770775 run iperf3-srv_10.42.42.10(pid=17969): Launched 00:16:59.882735 tst iperf3.py:8: start network... 00:17:00.082892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:00.545281 run create_hlr_db(pid=17970): Launched 00:17:00.668126 bus /gobi_6: Setting Powered False 00:17:01.728773 run create_hlr_db(pid=17970): Terminated: ok {rc=0} 00:17:02.166829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17975): Launched 00:17:02.474642 run osmo-hlr_10.42.42.2(pid=17976): Launched 00:17:02.589167 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:03.102922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17978): Launched 00:17:03.401766 run osmo-stp_10.42.42.5(pid=17979): Launched 00:17:03.514556 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:04.031498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17981): Launched 00:17:04.145755 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:04.398992 run patchelf(pid=17982): Launched 00:17:04.565419 run osmo-stp_10.42.42.5(pid=17979): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17979)] 00:17:04.691718 run osmo-stp_10.42.42.5(pid=17979): stdout: | (launched: 2022-12-14_00:17:03.346711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:04.819986 run osmo-stp_10.42.42.5(pid=17979): stderr: | [0;m[38;5;43m20221214001703518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001703518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001703518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001703518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001703519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001703519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001703519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:04.947940 run osmo-stp_10.42.42.5(pid=17979): stdout: | (launched: 2022-12-14_00:17:03.346711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:05.070141 run osmo-stp_10.42.42.5(pid=17979): stderr: | [0;m[38;5;43m20221214001703518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001703518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001703518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001703518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001703519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001703519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001703519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:05.215044 run patchelf(pid=17982): Terminating (SIGINT) 00:17:05.382996 run patchelf(pid=17982): Terminated: ok {rc=0} 00:17:05.504305 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17979): Process ended prematurely: osmo-stp_10.42.42.5(pid=17979) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17979)] [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 00:17:05.513768 tst iperf3.py:8: Test FAILED (7.3 sec) 00:17:05.540345 run osmo-hlr_10.42.42.2(pid=17976): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17976)] 00:17:05.587468 run osmo-hlr_10.42.42.2(pid=17976): stdout: | (launched: 2022-12-14_00:17:02.419700) 00:17:05.636117 run osmo-hlr_10.42.42.2(pid=17976): stderr: | [0;m[1;31m20221214001702596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001702596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001702596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001702596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001702596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001702596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001702609 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001702619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001702619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001702619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:05.685457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17968): Terminating (SIGTERM) 00:17:05.724616 run iperf3-srv_10.42.42.10(pid=17969): Terminating (SIGTERM) 00:17:05.763574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17975): Terminating (SIGTERM) 00:17:05.802801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17978): Terminating (SIGTERM) 00:17:05.841832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17981): Terminating (SIGTERM) 00:17:05.881227 --- ParallelTerminationStrategy: PID 17968 died... 00:17:05.900042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17968): Terminated: ok {rc=0} 00:17:05.943560 --- ParallelTerminationStrategy: PID 17969 died... 00:17:05.962073 run iperf3-srv_10.42.42.10(pid=17969): Terminated {rc=256} 00:17:06.005126 --- ParallelTerminationStrategy: PID 17975 died... 00:17:06.023648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17975): Terminated: ok {rc=0} 00:17:06.066807 --- ParallelTerminationStrategy: PID 17978 died... 00:17:06.085234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17978): Terminated: ok {rc=0} 00:17:06.128478 --- ParallelTerminationStrategy: PID 17981 died... 00:17:06.146788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17981): Terminated: ok {rc=0} 00:17:06.231387 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:17:07.378198 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:07.389914 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:17:07.450443 tst iperf3m4.py: using LAC 37229 00:17:07.568104 tst iperf3m4.py: using RAC 254 00:17:07.687390 tst iperf3m4.py: using CellId 37229 00:17:07.804810 tst iperf3m4.py: using BVCI 37230 00:17:07.913228 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:07.924307 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:07.935079 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:07.945826 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:07.957040 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:07.968441 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:07.979966 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:07.991207 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:08.002644 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:08.120087 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:08.240491 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:08.361133 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:08.477215 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:17:08.677824 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:17:08.977464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17983): Launched 00:17:09.237649 run iperf3-srv_10.42.42.10(pid=17984): Launched 00:17:09.350288 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:17:09.550660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:17:09.851851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17985): Launched 00:17:10.112458 run iperf3-srv_10.42.42.10(pid=17986): Launched 00:17:10.224836 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:17:10.426041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:17:10.726633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17987): Launched 00:17:10.986411 run iperf3-srv_10.42.42.10(pid=17988): Launched 00:17:11.098423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:17:11.298963 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:17:11.598770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17989): Launched 00:17:11.859161 run iperf3-srv_10.42.42.10(pid=17990): Launched 00:17:11.971320 tst iperf3m4.py:8: start network... 00:17:12.171676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:12.634125 run create_hlr_db(pid=17991): Launched 00:17:12.755604 bus /gobi_6: Setting Powered False 00:17:13.817121 run create_hlr_db(pid=17991): Terminated: ok {rc=0} 00:17:14.235088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17993): Launched 00:17:14.534154 run osmo-hlr_10.42.42.2(pid=17994): Launched 00:17:14.648129 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:15.178797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17996): Launched 00:17:15.476522 run osmo-stp_10.42.42.5(pid=17997): Launched 00:17:15.590936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:16.122231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17999): Launched 00:17:16.245919 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:16.510923 run patchelf(pid=18000): Launched 00:17:16.695056 run osmo-stp_10.42.42.5(pid=17997): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17997)] 00:17:16.824521 run osmo-stp_10.42.42.5(pid=17997): stdout: | (launched: 2022-12-14_00:17:15.421551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:16.955719 run osmo-stp_10.42.42.5(pid=17997): stderr: | [0;m[38;5;43m20221214001715590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001715591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001715591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001715591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001715593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001715594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001715594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:17.092136 run osmo-stp_10.42.42.5(pid=17997): stdout: | (launched: 2022-12-14_00:17:15.421551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:17.228817 run osmo-stp_10.42.42.5(pid=17997): stderr: | [0;m[38;5;43m20221214001715590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001715591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001715591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001715591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001715593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001715594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001715594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:17.388261 run patchelf(pid=18000): Terminating (SIGINT) 00:17:17.569063 run patchelf(pid=18000): Terminated: ok {rc=0} 00:17:17.698941 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17997): Process ended prematurely: osmo-stp_10.42.42.5(pid=17997) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17997)] [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:17:17.709345 tst iperf3m4.py:8: Test FAILED (10.4 sec) 00:17:17.738389 run osmo-hlr_10.42.42.2(pid=17994): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17994)] 00:17:17.789475 run osmo-hlr_10.42.42.2(pid=17994): stdout: | (launched: 2022-12-14_00:17:14.478925) 00:17:17.842183 run osmo-hlr_10.42.42.2(pid=17994): stderr: | [0;m[1;31m20221214001714655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001714655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001714655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001714656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001714656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001714656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001714666 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001714675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001714675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001714675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:17.895390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17983): Terminating (SIGTERM) 00:17:17.938068 run iperf3-srv_10.42.42.10(pid=17984): Terminating (SIGTERM) 00:17:17.980471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17985): Terminating (SIGTERM) 00:17:18.023501 run iperf3-srv_10.42.42.10(pid=17986): Terminating (SIGTERM) 00:17:18.066267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17987): Terminating (SIGTERM) 00:17:18.109529 run iperf3-srv_10.42.42.10(pid=17988): Terminating (SIGTERM) 00:17:18.152042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17989): Terminating (SIGTERM) 00:17:18.195065 run iperf3-srv_10.42.42.10(pid=17990): Terminating (SIGTERM) 00:17:18.237814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17993): Terminating (SIGTERM) 00:17:18.280606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17996): Terminating (SIGTERM) 00:17:18.323101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17999): Terminating (SIGTERM) 00:17:18.366390 --- ParallelTerminationStrategy: PID 17983 died... 00:17:18.386953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17983): Terminated: ok {rc=0} 00:17:18.433904 --- ParallelTerminationStrategy: PID 17984 died... 00:17:18.453934 run iperf3-srv_10.42.42.10(pid=17984): Terminated {rc=256} 00:17:18.500274 --- ParallelTerminationStrategy: PID 17985 died... 00:17:18.520251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17985): Terminated: ok {rc=0} 00:17:18.566657 --- ParallelTerminationStrategy: PID 17986 died... 00:17:18.586678 run iperf3-srv_10.42.42.10(pid=17986): Terminated {rc=256} 00:17:18.633079 --- ParallelTerminationStrategy: PID 17987 died... 00:17:18.653552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17987): Terminated: ok {rc=0} 00:17:18.700453 --- ParallelTerminationStrategy: PID 17988 died... 00:17:18.720429 run iperf3-srv_10.42.42.10(pid=17988): Terminated {rc=256} 00:17:18.766573 --- ParallelTerminationStrategy: PID 17989 died... 00:17:18.786600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17989): Terminated: ok {rc=0} 00:17:18.833291 --- ParallelTerminationStrategy: PID 17990 died... 00:17:18.853272 run iperf3-srv_10.42.42.10(pid=17990): Terminated {rc=256} 00:17:18.899569 --- ParallelTerminationStrategy: PID 17993 died... 00:17:18.919442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17993): Terminated: ok {rc=0} 00:17:18.965718 --- ParallelTerminationStrategy: PID 17996 died... 00:17:18.985812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17996): Terminated: ok {rc=0} 00:17:19.032175 --- ParallelTerminationStrategy: PID 17999 died... 00:17:19.052165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17999): Terminated: ok {rc=0} 00:17:19.140114 bus /gobi_4: Setting Powered False 00:17:20.239133 bus /gobi_4: Setting Powered False 00:17:21.356789 bus /gobi_1: Setting Powered False 00:17:22.455310 bus /gobi_1: Setting Powered False 00:17:23.569860 bus /gobi_0: Setting Powered False 00:17:24.668682 bus /gobi_0: Setting Powered False 00:17:25.783128 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:17:26.885452 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:26.897095 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:17:26.960922 tst ping.py: using LAC 37230 00:17:27.088670 tst ping.py: using RAC 255 00:17:27.206400 tst ping.py: using CellId 37230 00:17:27.320146 tst ping.py: using BVCI 37231 00:17:27.426042 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:27.437162 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:27.447943 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:27.458713 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:27.469544 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:27.481051 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:27.492343 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:27.503408 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:27.616760 tst ping.py:19: start network... 00:17:27.812908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:28.267466 run create_hlr_db(pid=18001): Launched 00:17:28.386841 bus /gobi_6: Setting Powered False 00:17:29.445600 run create_hlr_db(pid=18001): Terminated: ok {rc=0} 00:17:29.876687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18003): Launched 00:17:30.189651 run osmo-hlr_10.42.42.2(pid=18004): Launched 00:17:30.309801 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:30.861731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18006): Launched 00:17:31.199648 run osmo-stp_10.42.42.5(pid=18007): Launched 00:17:31.456016 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:32.022989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18009): Launched 00:17:32.158001 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:32.428051 run patchelf(pid=18010): Launched 00:17:32.601750 run osmo-stp_10.42.42.5(pid=18007): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18007)] 00:17:32.734492 run osmo-stp_10.42.42.5(pid=18007): stdout: | (launched: 2022-12-14_00:17:31.136891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:32.868570 run osmo-stp_10.42.42.5(pid=18007): stderr: | [0;m[38;5;43m20221214001731379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001731379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001731379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001731380 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001731382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001731382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001731382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:33.002731 run osmo-stp_10.42.42.5(pid=18007): stdout: | (launched: 2022-12-14_00:17:31.136891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:33.131350 run osmo-stp_10.42.42.5(pid=18007): stderr: | [0;m[38;5;43m20221214001731379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001731379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001731379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001731380 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001731382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001731382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001731382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:33.284421 run patchelf(pid=18010): Terminating (SIGINT) 00:17:33.460497 run patchelf(pid=18010): Terminated: ok {rc=0} 00:17:33.587454 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18007): Process ended prematurely: osmo-stp_10.42.42.5(pid=18007) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18007)] [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 00:17:33.596852 tst ping.py:22: Test FAILED (6.7 sec) 00:17:33.624620 run osmo-hlr_10.42.42.2(pid=18004): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18004)] 00:17:33.674585 run osmo-hlr_10.42.42.2(pid=18004): stdout: | (launched: 2022-12-14_00:17:30.132451) 00:17:33.726248 run osmo-hlr_10.42.42.2(pid=18004): stderr: | [0;m[1;31m20221214001730329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001730329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001730329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001730329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001730329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001730330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001730342 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001730351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001730351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001730351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:33.778132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18003): Terminating (SIGTERM) 00:17:33.819227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18006): Terminating (SIGTERM) 00:17:33.861218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18009): Terminating (SIGTERM) 00:17:33.903046 --- ParallelTerminationStrategy: PID 18003 died... 00:17:33.923449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18003): Terminated: ok {rc=0} 00:17:33.969351 --- ParallelTerminationStrategy: PID 18006 died... 00:17:33.989112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18006): Terminated: ok {rc=0} 00:17:34.035018 --- ParallelTerminationStrategy: PID 18009 died... 00:17:34.054724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18009): Terminated: ok {rc=0} 00:17:34.141288 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:17:35.226981 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:35.239117 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:17:35.302678 tst ping_idle_ping.py: using LAC 37231 00:17:35.427250 tst ping_idle_ping.py: using RAC 1 00:17:35.550084 tst ping_idle_ping.py: using CellId 37231 00:17:35.673435 tst ping_idle_ping.py: using BVCI 37232 00:17:35.782130 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:35.793233 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:35.804065 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:35.814834 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:35.826037 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:35.837241 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:35.848660 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:35.860202 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:35.979124 tst ping_idle_ping.py:24: start network... 00:17:36.191832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:36.679852 run create_hlr_db(pid=18011): Launched 00:17:36.799292 bus /gobi_6: Setting Powered False 00:17:37.862154 run create_hlr_db(pid=18011): Terminated: ok {rc=0} 00:17:38.283930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18013): Launched 00:17:38.576706 run osmo-hlr_10.42.42.2(pid=18014): Launched 00:17:38.689484 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:39.206794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18016): Launched 00:17:39.499120 run osmo-stp_10.42.42.5(pid=18017): Launched 00:17:39.610588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:40.117561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18019): Launched 00:17:40.229734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:40.477663 run patchelf(pid=18020): Launched 00:17:40.640402 run osmo-stp_10.42.42.5(pid=18017): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18017)] 00:17:40.764583 run osmo-stp_10.42.42.5(pid=18017): stdout: | (launched: 2022-12-14_00:17:39.445378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:40.890981 run osmo-stp_10.42.42.5(pid=18017): stderr: | [0;m[38;5;43m20221214001739613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001739613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001739613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001739613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001739614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001739614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001739614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:41.017087 run osmo-stp_10.42.42.5(pid=18017): stdout: | (launched: 2022-12-14_00:17:39.445378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:41.137489 run osmo-stp_10.42.42.5(pid=18017): stderr: | [0;m[38;5;43m20221214001739613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001739613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001739613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001739613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001739614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001739614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001739614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:41.280311 run patchelf(pid=18020): Terminating (SIGINT) 00:17:41.445123 run patchelf(pid=18020): Terminated: ok {rc=0} 00:17:41.563790 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18017): Process ended prematurely: osmo-stp_10.42.42.5(pid=18017) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18017)] [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:17:41.572491 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 00:17:41.598987 run osmo-hlr_10.42.42.2(pid=18014): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18014)] 00:17:41.645798 run osmo-hlr_10.42.42.2(pid=18014): stdout: | (launched: 2022-12-14_00:17:38.522749) 00:17:41.694322 run osmo-hlr_10.42.42.2(pid=18014): stderr: | [0;m[1;31m20221214001738699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001738699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001738699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001738699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001738699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001738699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001738711 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001738720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001738720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001738720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:41.743264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18013): Terminating (SIGTERM) 00:17:41.782568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18016): Terminating (SIGTERM) 00:17:41.821896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18019): Terminating (SIGTERM) 00:17:41.861539 --- ParallelTerminationStrategy: PID 18013 died... 00:17:41.880492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18013): Terminated: ok {rc=0} 00:17:41.923577 --- ParallelTerminationStrategy: PID 18016 died... 00:17:41.941995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18016): Terminated: ok {rc=0} 00:17:41.985091 --- ParallelTerminationStrategy: PID 18019 died... 00:17:42.003481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18019): Terminated: ok {rc=0} 00:17:42.085652 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 00:17:43.388799 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:17:43.397377 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:17:43.422148 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:17:43.459322 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:17:43.511431 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:17:43.535940 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:17:43.571404 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:17:44.138040 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:17:44.143629 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:44.155810 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:17:44.217932 tst switch_tch_pdch.py: using LAC 37232 00:17:44.339886 tst switch_tch_pdch.py: using RAC 2 00:17:44.461168 tst switch_tch_pdch.py: using CellId 37232 00:17:44.583189 tst switch_tch_pdch.py: using BVCI 37233 00:17:44.697157 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:44.709398 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:44.721189 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:44.733271 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:44.746230 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:44.758930 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:44.771850 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:44.784596 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:17:44.903449 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:17:45.023358 tst switch_tch_pdch.py:51: start network... 00:17:45.235930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:45.722283 run create_hlr_db(pid=18024): Launched 00:17:45.842118 bus /gobi_6: Setting Powered False 00:17:46.900279 run create_hlr_db(pid=18024): Terminated: ok {rc=0} 00:17:47.324308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18026): Launched 00:17:47.617385 run osmo-hlr_10.42.42.2(pid=18027): Launched 00:17:47.728391 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:48.233662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18029): Launched 00:17:48.527047 run osmo-stp_10.42.42.5(pid=18030): Launched 00:17:48.638705 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:49.145153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18032): Launched 00:17:49.257405 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:49.504594 run patchelf(pid=18033): Launched 00:17:49.669246 run osmo-stp_10.42.42.5(pid=18030): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18030)] 00:17:49.793520 run osmo-stp_10.42.42.5(pid=18030): stdout: | (launched: 2022-12-14_00:17:48.472731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:49.919732 run osmo-stp_10.42.42.5(pid=18030): stderr: | [0;m[38;5;43m20221214001748642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001748642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001748642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001748643 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001748643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001748643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001748643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:50.045540 run osmo-stp_10.42.42.5(pid=18030): stdout: | (launched: 2022-12-14_00:17:48.472731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:50.166908 run osmo-stp_10.42.42.5(pid=18030): stderr: | [0;m[38;5;43m20221214001748642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001748642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001748642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001748643 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001748643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001748643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001748643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:50.310251 run patchelf(pid=18033): Terminating (SIGINT) 00:17:50.475293 run patchelf(pid=18033): Terminated: ok {rc=0} 00:17:50.594243 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18030): Process ended prematurely: osmo-stp_10.42.42.5(pid=18030) [trial-2396↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18030)] [trial-2396↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:17:50.602981 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 00:17:50.629383 run osmo-hlr_10.42.42.2(pid=18027): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18027)] 00:17:50.676641 run osmo-hlr_10.42.42.2(pid=18027): stdout: | (launched: 2022-12-14_00:17:47.563490) 00:17:50.725786 run osmo-hlr_10.42.42.2(pid=18027): stderr: | [0;m[1;31m20221214001747738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001747738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001747738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001747738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001747738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001747738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001747752 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001747762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001747762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001747762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:50.775213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18026): Terminating (SIGTERM) 00:17:50.815242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18029): Terminating (SIGTERM) 00:17:50.855044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18032): Terminating (SIGTERM) 00:17:50.894889 --- ParallelTerminationStrategy: PID 18026 died... 00:17:50.914151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18026): Terminated: ok {rc=0} 00:17:50.957895 --- ParallelTerminationStrategy: PID 18029 died... 00:17:50.976517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18029): Terminated: ok {rc=0} 00:17:51.019989 --- ParallelTerminationStrategy: PID 18032 died... 00:17:51.038607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18032): Terminated: ok {rc=0} 00:17:51.123782 bus /gobi_0: Setting Powered False 00:17:52.222512 bus /gobi_0: Setting Powered False 00:17:53.335168 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 sms:nanobts+band-900 --------------------------------------------------------------------- 00:17:54.581729 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:17:54.586511 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:17:54.617942 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 00:17:54.645026 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 00:17:54.695929 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:17:54.727294 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 00:17:54.754281 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 00:17:55.302713 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 00:17:55.307970 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:55.318826 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 00:17:55.365417 tst mo_mt_sms.py: using LAC 37233 00:17:55.489184 tst mo_mt_sms.py: using RAC 3 00:17:55.612935 tst mo_mt_sms.py: using CellId 37233 00:17:55.737626 tst mo_mt_sms.py: using BVCI 37234 00:17:55.845824 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:55.856453 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:55.867112 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:55.877756 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:55.888873 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:55.899936 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 00:17:56.019351 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 00:17:56.134520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:56.590152 run create_hlr_db(pid=18037): Launched 00:17:56.710448 bus /gobi_6: Setting Powered False 00:17:57.769761 run create_hlr_db(pid=18037): Terminated: ok {rc=0} 00:17:58.198169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18039): Launched 00:17:58.511493 run osmo-hlr_10.42.42.2(pid=18040): Launched 00:17:58.631543 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:59.169876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18042): Launched 00:17:59.483417 run osmo-stp_10.42.42.5(pid=18043): Launched 00:17:59.603764 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:00.169930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18045): Launched 00:18:00.484074 run osmo-msc_10.42.42.6(pid=18046): Launched 00:18:00.660086 run osmo-stp_10.42.42.5(pid=18043): ERR: Terminated: ERROR {rc=1} [trial-2396↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18043)] 00:18:00.793584 run osmo-stp_10.42.42.5(pid=18043): stdout: | (launched: 2022-12-14_00:17:59.426019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:00.990419 run osmo-stp_10.42.42.5(pid=18043): stderr: | [0;m[38;5;43m20221214001759615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001759615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001759616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001759616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001759616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001759617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001759617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:01.177803 run osmo-stp_10.42.42.5(pid=18043): stdout: | (launched: 2022-12-14_00:17:59.426019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:01.300176 run osmo-stp_10.42.42.5(pid=18043): stderr: | [0;m[38;5;43m20221214001759615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001759615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001759616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001759616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001759616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001759617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001759617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:01.446533 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=18043): Process ended prematurely: osmo-stp_10.42.42.5(pid=18043) [trial-2396↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18043)] [trial-2396↪sms:nanobts+band-900↪mo_mt_sms.py:16] 00:18:01.455337 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 00:18:01.482536 run osmo-hlr_10.42.42.2(pid=18040): ERR: Terminated: ERROR {rc=237} [trial-2396↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18040)] 00:18:01.532306 run osmo-hlr_10.42.42.2(pid=18040): stdout: | (launched: 2022-12-14_00:17:58.454628) 00:18:01.584028 run osmo-hlr_10.42.42.2(pid=18040): stderr: | [0;m[1;31m20221214001758650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001758650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001758650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001758651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001758651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001758651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001758666 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001758675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001758675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001758675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:01.655720 run osmo-msc_10.42.42.6(pid=18046): ERR: Terminated: ERROR {rc=2} [trial-2396↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18046)] 00:18:01.704657 run osmo-msc_10.42.42.6(pid=18046): stdout: | (launched: 2022-12-14_00:18:00.426682) 00:18:01.756289 run osmo-msc_10.42.42.6(pid=18046): stderr: | [0;m[38;5;43m20221214001800745 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001800745 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff4fb849c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001800745 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001800745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001800745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001800746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001800747 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001800748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001800748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001800748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:01.807306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18039): Terminating (SIGTERM) 00:18:01.849512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18042): Terminating (SIGTERM) 00:18:01.894003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18045): Terminating (SIGTERM) 00:18:01.937666 --- ParallelTerminationStrategy: PID 18039 died... 00:18:01.957865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18039): Terminated: ok {rc=0} 00:18:02.004917 --- ParallelTerminationStrategy: PID 18042 died... 00:18:02.024780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18042): Terminated: ok {rc=0} 00:18:02.070967 --- ParallelTerminationStrategy: PID 18045 died... 00:18:02.090745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18045): Terminated: ok {rc=0} 00:18:02.177513 bus /sierra_3: Setting Powered False 00:18:03.273869 bus /sierra_3: Setting Powered False 00:18:04.384458 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 00:18:05.622675 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:18:05.628125 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:18:05.661090 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 00:18:05.669684 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 00:18:05.706078 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:18:05.738967 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 00:18:05.745906 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 00:18:06.266218 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2396 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 00:18:06.271378 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 00:18:06.282683 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 00:18:06.330657 tst assert_extension.py: using LAC 37234 00:18:06.454387 tst assert_extension.py: using RAC 4 00:18:06.577045 tst assert_extension.py: using CellId 37234 00:18:06.700616 tst assert_extension.py: using BVCI 37235 00:18:06.809742 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 00:18:06.925842 tst assert_extension.py:10: start nitb and bts... 00:18:07.137549 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:18:07.776882 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18051): Launched 00:18:08.089924 run osmo-nitb_10.42.42.2(pid=18052): Launched 00:18:08.263707 run osmo-nitb_10.42.42.2(pid=18052): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18052)] 00:18:08.405029 run osmo-nitb_10.42.42.2(pid=18052): stdout: | (launched: 2022-12-14_00:18:08.032906) 00:18:08.547738 run osmo-nitb_10.42.42.2(pid=18052): stderr: | (launched: 2022-12-14_00:18:08.079478) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:18:08.690164 run osmo-nitb_10.42.42.2(pid=18052): stdout: | (launched: 2022-12-14_00:18:08.032906) 00:18:08.827168 run osmo-nitb_10.42.42.2(pid=18052): stderr: | (launched: 2022-12-14_00:18:08.079478) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18052): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18052) [trial-2396↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18052)] 00:18:09.208257 tst osmo-nitb_10.42.42.2(pid=18052): stdout: | (launched: 2022-12-14_00:18:08.032906) 00:18:09.335796 tst osmo-nitb_10.42.42.2(pid=18052): stderr: | (launched: 2022-12-14_00:18:08.079478) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:18:09.485170 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=18052): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18052) [trial-2396↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18052)] [trial-2396↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 00:18:09.494028 tst assert_extension.py:12: Test FAILED (3.2 sec) 00:18:09.500796 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18051): Terminating (SIGTERM) 00:18:09.711203 --- ParallelTerminationStrategy: PID 18051 died... 00:18:09.731863 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18051): Terminated: ok {rc=0} 00:18:09.818828 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 ussd:nanobts+band-900 --------------------------------------------------------------------- 00:18:10.992931 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:18:10.997541 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:18:11.029093 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 00:18:11.055379 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 00:18:11.089608 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:18:11.122866 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 00:18:11.150239 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 00:18:11.680142 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2396 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 00:18:11.685540 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:11.696465 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 00:18:11.743612 tst assert_extension.py: using LAC 37235 00:18:11.864747 tst assert_extension.py: using RAC 5 00:18:11.979077 tst assert_extension.py: using CellId 37235 00:18:12.101377 tst assert_extension.py: using BVCI 37236 00:18:12.215141 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:12.226517 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:12.238179 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:12.249394 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:12.260859 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:12.272143 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 00:18:12.387259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:12.841219 run create_hlr_db(pid=18057): Launched 00:18:12.961294 bus /sierra_2: Setting Powered False 00:18:14.019221 run create_hlr_db(pid=18057): Terminated: ok {rc=0} 00:18:14.430761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18059): Launched 00:18:14.724096 run osmo-hlr_10.42.42.2(pid=18060): Launched 00:18:14.836254 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:15.357215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18062): Launched 00:18:15.651158 run osmo-stp_10.42.42.5(pid=18063): Launched 00:18:15.762840 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:16.387216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18065): Launched 00:18:16.726794 run osmo-msc_10.42.42.6(pid=18066): Launched 00:18:17.112365 run osmo-stp_10.42.42.5(pid=18063): ERR: Terminated: ERROR {rc=1} [trial-2396↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18063)] 00:18:17.329041 run osmo-stp_10.42.42.5(pid=18063): stdout: | (launched: 2022-12-14_00:18:15.596194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:17.451568 run osmo-stp_10.42.42.5(pid=18063): stderr: | [0;m[38;5;43m20221214001815765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001815765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001815766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001815766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001815768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001815768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001815768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:17.574131 run osmo-stp_10.42.42.5(pid=18063): stdout: | (launched: 2022-12-14_00:18:15.596194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:17.690633 run osmo-stp_10.42.42.5(pid=18063): stderr: | [0;m[38;5;43m20221214001815765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001815765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001815766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001815766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001815768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001815768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001815768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:17.830427 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=18063): Process ended prematurely: osmo-stp_10.42.42.5(pid=18063) [trial-2396↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18063)] [trial-2396↪ussd:nanobts+band-900↪assert_extension.py:17] 00:18:17.838541 tst assert_extension.py:17: Test FAILED (6.1 sec) 00:18:17.864360 run osmo-hlr_10.42.42.2(pid=18060): ERR: Terminated: ERROR {rc=237} [trial-2396↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18060)] 00:18:17.912321 run osmo-hlr_10.42.42.2(pid=18060): stdout: | (launched: 2022-12-14_00:18:14.670352) 00:18:17.961780 run osmo-hlr_10.42.42.2(pid=18060): stderr: | [0;m[1;31m20221214001814843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001814843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001814843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001814843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001814843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001814843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001814856 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001814865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001814865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001814865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:18.030738 run osmo-msc_10.42.42.6(pid=18066): ERR: Terminated: ERROR {rc=2} [trial-2396↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18066)] 00:18:18.078431 run osmo-msc_10.42.42.6(pid=18066): stdout: | (launched: 2022-12-14_00:18:16.664171) 00:18:18.127848 run osmo-msc_10.42.42.6(pid=18066): stderr: | [0;m[38;5;43m20221214001817058 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001817058 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fca438a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001817058 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001817058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001817058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001817059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001817070 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001817070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001817070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001817071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:18.177718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18059): Terminating (SIGTERM) 00:18:18.217502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18062): Terminating (SIGTERM) 00:18:18.257105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18065): Terminating (SIGTERM) 00:18:18.297062 --- ParallelTerminationStrategy: PID 18059 died... 00:18:18.315929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18059): Terminated: ok {rc=0} 00:18:18.360848 --- ParallelTerminationStrategy: PID 18062 died... 00:18:18.380108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18062): Terminated: ok {rc=0} 00:18:18.424019 --- ParallelTerminationStrategy: PID 18065 died... 00:18:18.442693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18065): Terminated: ok {rc=0} 00:18:18.527176 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:18:19.739817 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:18:19.748018 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:18:19.779811 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:18:19.806807 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:18:19.857942 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:18:19.891342 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:18:19.919168 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:18:20.468745 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:18:20.517560 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:20.528591 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:18:20.593458 tst mo_mt_call.py: using LAC 37236 00:18:20.709887 tst mo_mt_call.py: using RAC 6 00:18:20.825638 tst mo_mt_call.py: using CellId 37236 00:18:20.941541 tst mo_mt_call.py: using BVCI 37237 00:18:21.051842 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:21.063009 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:21.074058 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:21.084996 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:21.096107 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:21.107197 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:18:21.227990 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:18:21.348602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:21.844528 run create_hlr_db(pid=18072): Launched 00:18:21.967451 bus /sierra_2: Setting Powered False 00:18:23.030887 run create_hlr_db(pid=18072): Terminated: ok {rc=0} 00:18:23.477494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18074): Launched 00:18:23.796690 run osmo-hlr_10.42.42.2(pid=18075): Launched 00:18:23.919645 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:24.471786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18077): Launched 00:18:24.791180 run osmo-stp_10.42.42.5(pid=18078): Launched 00:18:24.913824 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:25.491576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18080): Launched 00:18:25.794800 run osmo-msc_10.42.42.6(pid=18081): Launched 00:18:25.960766 run osmo-stp_10.42.42.5(pid=18078): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18078)] 00:18:26.085873 run osmo-stp_10.42.42.5(pid=18078): stdout: | (launched: 2022-12-14_00:18:24.733165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:26.212274 run osmo-stp_10.42.42.5(pid=18078): stderr: | [0;m[38;5;43m20221214001824923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001824924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001824924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001824924 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001824925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001824925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001824925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:26.336372 run osmo-stp_10.42.42.5(pid=18078): stdout: | (launched: 2022-12-14_00:18:24.733165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:26.455819 run osmo-stp_10.42.42.5(pid=18078): stderr: | [0;m[38;5;43m20221214001824923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001824924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001824924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001824924 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001824925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001824925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001824925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:26.598039 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18078): Process ended prematurely: osmo-stp_10.42.42.5(pid=18078) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18078)] [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:18:26.606820 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:18:26.632925 run osmo-hlr_10.42.42.2(pid=18075): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18075)] 00:18:26.680636 run osmo-hlr_10.42.42.2(pid=18075): stdout: | (launched: 2022-12-14_00:18:23.738368) 00:18:26.729689 run osmo-hlr_10.42.42.2(pid=18075): stderr: | [0;m[1;31m20221214001823936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001823936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001823936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001823936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001823936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001823936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001823948 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001823956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001823957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001823957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:26.798503 run osmo-msc_10.42.42.6(pid=18081): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18081)] 00:18:26.845772 run osmo-msc_10.42.42.6(pid=18081): stdout: | (launched: 2022-12-14_00:18:25.740153) 00:18:26.894709 run osmo-msc_10.42.42.6(pid=18081): stderr: | [0;m[38;5;43m20221214001826010 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001826010 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1574bb7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001826010 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001826010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001826011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001826011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001826012 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001826013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001826013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001826013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:26.944013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18074): Terminating (SIGTERM) 00:18:26.982967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18077): Terminating (SIGTERM) 00:18:27.021992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18080): Terminating (SIGTERM) 00:18:27.061946 --- ParallelTerminationStrategy: PID 18074 died... 00:18:27.080851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18074): Terminated: ok {rc=0} 00:18:27.124650 --- ParallelTerminationStrategy: PID 18077 died... 00:18:27.143100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18077): Terminated: ok {rc=0} 00:18:27.186712 --- ParallelTerminationStrategy: PID 18080 died... 00:18:27.205235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18080): Terminated: ok {rc=0} 00:18:27.287970 bus /sierra_3: Setting Powered False 00:18:28.382622 bus /sierra_3: Setting Powered False 00:18:29.496729 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:18:30.640868 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:30.652747 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:18:30.720036 tst mo_mt_call_osmux.py: using LAC 37237 00:18:30.838727 tst mo_mt_call_osmux.py: using RAC 7 00:18:30.989345 tst mo_mt_call_osmux.py: using CellId 37237 00:18:31.120657 tst mo_mt_call_osmux.py: using BVCI 37238 00:18:31.241400 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:31.255454 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:31.268050 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:31.280778 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:31.294889 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:31.308598 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:18:31.438866 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:18:31.572688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:32.085526 run create_hlr_db(pid=18083): Launched 00:18:32.234092 bus /sierra_2: Setting Powered False 00:18:33.294120 run create_hlr_db(pid=18083): Terminated: ok {rc=0} 00:18:33.731339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18085): Launched 00:18:34.034521 run osmo-hlr_10.42.42.2(pid=18086): Launched 00:18:34.148581 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:34.663299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18088): Launched 00:18:34.961593 run osmo-stp_10.42.42.5(pid=18089): Launched 00:18:35.075368 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:35.615696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18091): Launched 00:18:35.914439 run osmo-msc_10.42.42.6(pid=18092): Launched 00:18:36.082675 run osmo-stp_10.42.42.5(pid=18089): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18089)] 00:18:36.210236 run osmo-stp_10.42.42.5(pid=18089): stdout: | (launched: 2022-12-14_00:18:34.906826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:36.337248 run osmo-stp_10.42.42.5(pid=18089): stderr: | [0;m[38;5;43m20221214001835078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001835078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001835078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001835079 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001835079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001835079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001835079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:36.461463 run osmo-stp_10.42.42.5(pid=18089): stdout: | (launched: 2022-12-14_00:18:34.906826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:36.580808 run osmo-stp_10.42.42.5(pid=18089): stderr: | [0;m[38;5;43m20221214001835078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001835078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001835078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001835079 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001835079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001835079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001835079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:36.722946 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18089): Process ended prematurely: osmo-stp_10.42.42.5(pid=18089) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18089)] [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:18:36.731571 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 00:18:36.757646 run osmo-hlr_10.42.42.2(pid=18086): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18086)] 00:18:36.805096 run osmo-hlr_10.42.42.2(pid=18086): stdout: | (launched: 2022-12-14_00:18:33.979826) 00:18:36.854000 run osmo-hlr_10.42.42.2(pid=18086): stderr: | [0;m[1;31m20221214001834154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001834154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001834154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001834154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001834155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001834155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001834167 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001834176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001834176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001834176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:36.922211 run osmo-msc_10.42.42.6(pid=18092): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18092)] 00:18:36.969230 run osmo-msc_10.42.42.6(pid=18092): stdout: | (launched: 2022-12-14_00:18:35.859436) 00:18:37.018010 run osmo-msc_10.42.42.6(pid=18092): stderr: | [0;m[38;5;43m20221214001836130 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001836130 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8174bbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001836130 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001836130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001836130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001836131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001836132 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001836133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001836133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001836133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:37.066964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18085): Terminating (SIGTERM) 00:18:37.106192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18088): Terminating (SIGTERM) 00:18:37.145193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18091): Terminating (SIGTERM) 00:18:37.184470 --- ParallelTerminationStrategy: PID 18085 died... 00:18:37.203497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18085): Terminated: ok {rc=0} 00:18:37.247025 --- ParallelTerminationStrategy: PID 18088 died... 00:18:37.265527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18088): Terminated: ok {rc=0} 00:18:37.308749 --- ParallelTerminationStrategy: PID 18091 died... 00:18:37.327461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18091): Terminated: ok {rc=0} 00:18:37.411867 bus /sierra_3: Setting Powered False 00:18:38.510551 bus /sierra_3: Setting Powered False 00:18:39.624688 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:18:40.883887 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:18:40.891845 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:18:40.925256 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:18:40.952897 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:18:41.003997 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:18:41.035645 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:18:41.061888 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:18:41.615891 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:18:41.663605 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:41.674835 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:18:41.738816 tst mo_mt_call.py: using LAC 37238 00:18:41.856008 tst mo_mt_call.py: using RAC 8 00:18:41.980813 tst mo_mt_call.py: using CellId 37238 00:18:42.104380 tst mo_mt_call.py: using BVCI 37239 00:18:42.221774 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:42.233544 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:42.245119 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:42.257209 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:42.268911 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:42.280643 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:18:42.397622 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:18:42.516942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:43.011442 run create_hlr_db(pid=18097): Launched 00:18:43.132590 bus /sierra_2: Setting Powered False 00:18:44.196071 run create_hlr_db(pid=18097): Terminated: ok {rc=0} 00:18:44.624852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18099): Launched 00:18:44.922218 run osmo-hlr_10.42.42.2(pid=18100): Launched 00:18:45.035234 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:45.552695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18102): Launched 00:18:45.860559 run osmo-stp_10.42.42.5(pid=18103): Launched 00:18:46.118586 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:47.043835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18105): Launched 00:18:47.402088 run osmo-msc_10.42.42.6(pid=18106): Launched 00:18:47.585708 run osmo-stp_10.42.42.5(pid=18103): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18103)] 00:18:47.722534 run osmo-stp_10.42.42.5(pid=18103): stdout: | (launched: 2022-12-14_00:18:45.796465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:47.859762 run osmo-stp_10.42.42.5(pid=18103): stderr: | [0;m[38;5;43m20221214001846147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001846148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001846149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001846151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001846153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001846153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001846153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:47.988269 run osmo-stp_10.42.42.5(pid=18103): stdout: | (launched: 2022-12-14_00:18:45.796465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:48.107410 run osmo-stp_10.42.42.5(pid=18103): stderr: | [0;m[38;5;43m20221214001846147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001846148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001846149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001846151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001846153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001846153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001846153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:48.250220 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18103): Process ended prematurely: osmo-stp_10.42.42.5(pid=18103) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18103)] [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:18:48.259186 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 00:18:48.285671 run osmo-hlr_10.42.42.2(pid=18100): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18100)] 00:18:48.333651 run osmo-hlr_10.42.42.2(pid=18100): stdout: | (launched: 2022-12-14_00:18:44.867853) 00:18:48.383421 run osmo-hlr_10.42.42.2(pid=18100): stderr: | [0;m[1;31m20221214001845042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001845042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001845042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001845042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001845042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001845042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001845055 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001845064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001845064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001845064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:48.452735 run osmo-msc_10.42.42.6(pid=18106): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18106)] 00:18:48.500284 run osmo-msc_10.42.42.6(pid=18106): stdout: | (launched: 2022-12-14_00:18:47.343945) 00:18:48.549471 run osmo-msc_10.42.42.6(pid=18106): stderr: | [0;m[38;5;43m20221214001847662 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001847662 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8f48938c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001847662 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001847662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001847662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001847663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001847664 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001847665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001847665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001847665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:48.599259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18099): Terminating (SIGTERM) 00:18:48.639204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18102): Terminating (SIGTERM) 00:18:48.678888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18105): Terminating (SIGTERM) 00:18:48.718703 --- ParallelTerminationStrategy: PID 18099 died... 00:18:48.738080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18099): Terminated: ok {rc=0} 00:18:48.782339 --- ParallelTerminationStrategy: PID 18102 died... 00:18:48.800940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18102): Terminated: ok {rc=0} 00:18:48.844918 --- ParallelTerminationStrategy: PID 18105 died... 00:18:48.864051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18105): Terminated: ok {rc=0} 00:18:48.949119 bus /sierra_3: Setting Powered False 00:18:50.048226 bus /sierra_3: Setting Powered False 00:18:51.159875 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:18:52.307926 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:52.320296 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:18:52.389384 tst mo_mt_call_osmux.py: using LAC 37239 00:18:52.516346 tst mo_mt_call_osmux.py: using RAC 9 00:18:52.641142 tst mo_mt_call_osmux.py: using CellId 37239 00:18:52.768084 tst mo_mt_call_osmux.py: using BVCI 37240 00:18:52.883800 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:52.895432 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:52.907049 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:52.918456 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:52.930287 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:52.942037 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:18:53.061758 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:18:53.176524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:53.639048 run create_hlr_db(pid=18108): Launched 00:18:53.761300 bus /sierra_2: Setting Powered False 00:18:54.820855 run create_hlr_db(pid=18108): Terminated: ok {rc=0} 00:18:55.236853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18110): Launched 00:18:55.534837 run osmo-hlr_10.42.42.2(pid=18111): Launched 00:18:55.647627 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:56.179517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18113): Launched 00:18:56.478438 run osmo-stp_10.42.42.5(pid=18114): Launched 00:18:56.591705 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:57.132180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18116): Launched 00:18:57.430632 run osmo-msc_10.42.42.6(pid=18117): Launched 00:18:57.597948 run osmo-stp_10.42.42.5(pid=18114): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18114)] 00:18:57.725101 run osmo-stp_10.42.42.5(pid=18114): stdout: | (launched: 2022-12-14_00:18:56.423210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:57.851861 run osmo-stp_10.42.42.5(pid=18114): stderr: | [0;m[38;5;43m20221214001856594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001856594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001856594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001856595 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001856595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001856595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001856595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:57.977222 run osmo-stp_10.42.42.5(pid=18114): stdout: | (launched: 2022-12-14_00:18:56.423210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:58.096120 run osmo-stp_10.42.42.5(pid=18114): stderr: | [0;m[38;5;43m20221214001856594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001856594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001856594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001856595 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001856595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001856595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001856595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:58.238645 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18114): Process ended prematurely: osmo-stp_10.42.42.5(pid=18114) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18114)] [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:18:58.247564 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:18:58.273685 run osmo-hlr_10.42.42.2(pid=18111): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18111)] 00:18:58.320801 run osmo-hlr_10.42.42.2(pid=18111): stdout: | (launched: 2022-12-14_00:18:55.480257) 00:18:58.369584 run osmo-hlr_10.42.42.2(pid=18111): stderr: | [0;m[1;31m20221214001855659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001855659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001855659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001855659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001855659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001855659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001855672 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001855680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001855681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001855681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:58.437821 run osmo-msc_10.42.42.6(pid=18117): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18117)] 00:18:58.485526 run osmo-msc_10.42.42.6(pid=18117): stdout: | (launched: 2022-12-14_00:18:57.375928) 00:18:58.534280 run osmo-msc_10.42.42.6(pid=18117): stderr: | [0;m[38;5;43m20221214001857648 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001857648 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff2d784ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001857648 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001857648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001857648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001857649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001857650 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001857651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001857651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001857651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:58.583138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18110): Terminating (SIGTERM) 00:18:58.622197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18113): Terminating (SIGTERM) 00:18:58.661256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18116): Terminating (SIGTERM) 00:18:58.700833 --- ParallelTerminationStrategy: PID 18110 died... 00:18:58.719890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18110): Terminated: ok {rc=0} 00:18:58.763300 --- ParallelTerminationStrategy: PID 18113 died... 00:18:58.781977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18113): Terminated: ok {rc=0} 00:18:58.825310 --- ParallelTerminationStrategy: PID 18116 died... 00:18:58.843522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18116): Terminated: ok {rc=0} 00:18:58.928028 bus /sierra_3: Setting Powered False 00:19:00.025680 bus /sierra_3: Setting Powered False 00:19:01.141920 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:19:02.416384 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:19:02.424480 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:19:02.458567 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:19:02.486213 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:19:02.537179 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:19:02.569537 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:19:02.596597 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:19:03.148775 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:19:03.197551 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:03.208639 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:19:03.273874 tst mo_mt_call.py: using LAC 37240 00:19:03.389503 tst mo_mt_call.py: using RAC 10 00:19:03.505181 tst mo_mt_call.py: using CellId 37240 00:19:03.622593 tst mo_mt_call.py: using BVCI 37241 00:19:03.730758 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:03.741919 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:03.752894 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:03.763919 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:03.775475 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:03.786965 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:19:03.906321 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:19:04.022726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:04.486339 run create_hlr_db(pid=18123): Launched 00:19:04.608629 bus /sierra_2: Setting Powered False 00:19:05.668781 run create_hlr_db(pid=18123): Terminated: ok {rc=0} 00:19:06.085436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18125): Launched 00:19:06.383891 run osmo-hlr_10.42.42.2(pid=18126): Launched 00:19:06.497644 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:07.009849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18128): Launched 00:19:07.307833 run osmo-stp_10.42.42.5(pid=18129): Launched 00:19:07.421859 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:07.961982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18131): Launched 00:19:08.260643 run osmo-msc_10.42.42.6(pid=18132): Launched 00:19:08.427790 run osmo-stp_10.42.42.5(pid=18129): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18129)] 00:19:08.554586 run osmo-stp_10.42.42.5(pid=18129): stdout: | (launched: 2022-12-14_00:19:07.253038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:08.680888 run osmo-stp_10.42.42.5(pid=18129): stderr: | [0;m[38;5;43m20221214001907424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001907424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001907425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001907425 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001907425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001907426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001907426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:08.806037 run osmo-stp_10.42.42.5(pid=18129): stdout: | (launched: 2022-12-14_00:19:07.253038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:08.924919 run osmo-stp_10.42.42.5(pid=18129): stderr: | [0;m[38;5;43m20221214001907424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001907424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001907425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001907425 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001907425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001907426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001907426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:09.067212 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18129): Process ended prematurely: osmo-stp_10.42.42.5(pid=18129) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18129)] [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:19:09.075986 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 00:19:09.102359 run osmo-hlr_10.42.42.2(pid=18126): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18126)] 00:19:09.149434 run osmo-hlr_10.42.42.2(pid=18126): stdout: | (launched: 2022-12-14_00:19:06.329215) 00:19:09.198192 run osmo-hlr_10.42.42.2(pid=18126): stderr: | [0;m[1;31m20221214001906508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001906508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001906508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001906508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001906508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001906508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001906521 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001906529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001906529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001906530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:09.266486 run osmo-msc_10.42.42.6(pid=18132): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18132)] 00:19:09.313442 run osmo-msc_10.42.42.6(pid=18132): stdout: | (launched: 2022-12-14_00:19:08.205836) 00:19:09.361944 run osmo-msc_10.42.42.6(pid=18132): stderr: | [0;m[38;5;43m20221214001908478 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001908478 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdfd1087c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001908478 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001908478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001908479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001908479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001908480 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001908481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001908481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001908481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:09.410730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18125): Terminating (SIGTERM) 00:19:09.449576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18128): Terminating (SIGTERM) 00:19:09.488555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18131): Terminating (SIGTERM) 00:19:09.527822 --- ParallelTerminationStrategy: PID 18125 died... 00:19:09.546664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18125): Terminated: ok {rc=0} 00:19:09.590128 --- ParallelTerminationStrategy: PID 18128 died... 00:19:09.608536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18128): Terminated: ok {rc=0} 00:19:09.652010 --- ParallelTerminationStrategy: PID 18131 died... 00:19:09.670457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18131): Terminated: ok {rc=0} 00:19:09.755061 bus /sierra_3: Setting Powered False 00:19:10.852836 bus /sierra_3: Setting Powered False 00:19:11.963911 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:19:13.112052 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:13.124312 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:19:13.193395 tst mo_mt_call_osmux.py: using LAC 37241 00:19:13.311198 tst mo_mt_call_osmux.py: using RAC 11 00:19:13.428539 tst mo_mt_call_osmux.py: using CellId 37241 00:19:13.546720 tst mo_mt_call_osmux.py: using BVCI 37242 00:19:13.657172 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:13.668487 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:13.679697 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:13.690818 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:13.702030 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:13.713249 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:19:13.827765 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:19:13.950924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:14.447299 run create_hlr_db(pid=18134): Launched 00:19:14.570497 bus /sierra_2: Setting Powered False 00:19:15.633710 run create_hlr_db(pid=18134): Terminated: ok {rc=0} 00:19:16.112263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18136): Launched 00:19:16.447804 run osmo-hlr_10.42.42.2(pid=18137): Launched 00:19:16.619997 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:17.435541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18139): Launched 00:19:17.754135 run osmo-stp_10.42.42.5(pid=18140): Launched 00:19:17.875437 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:18.452233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18142): Launched 00:19:18.771351 run osmo-msc_10.42.42.6(pid=18143): Launched 00:19:18.950009 run osmo-stp_10.42.42.5(pid=18140): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18140)] 00:19:19.085303 run osmo-stp_10.42.42.5(pid=18140): stdout: | (launched: 2022-12-14_00:19:17.696198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:19.220682 run osmo-stp_10.42.42.5(pid=18140): stderr: | [0;m[38;5;43m20221214001917887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001917887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001917887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001917888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001917890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001917890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001917890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:19.355965 run osmo-stp_10.42.42.5(pid=18140): stdout: | (launched: 2022-12-14_00:19:17.696198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:19.483767 run osmo-stp_10.42.42.5(pid=18140): stderr: | [0;m[38;5;43m20221214001917887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001917887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001917887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001917888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001917890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001917890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001917890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:19.636461 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18140): Process ended prematurely: osmo-stp_10.42.42.5(pid=18140) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18140)] [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:19:19.646282 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 00:19:19.673856 run osmo-hlr_10.42.42.2(pid=18137): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18137)] 00:19:19.724386 run osmo-hlr_10.42.42.2(pid=18137): stdout: | (launched: 2022-12-14_00:19:16.375836) 00:19:19.776330 run osmo-hlr_10.42.42.2(pid=18137): stderr: | [0;m[1;31m20221214001916696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001916696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001916696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001916696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001916696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001916696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001916717 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001916737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001916737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001916737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:19.848652 run osmo-msc_10.42.42.6(pid=18143): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18143)] 00:19:19.898194 run osmo-msc_10.42.42.6(pid=18143): stdout: | (launched: 2022-12-14_00:19:18.713427) 00:19:19.949961 run osmo-msc_10.42.42.6(pid=18143): stderr: | [0;m[38;5;43m20221214001919033 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001919033 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f204bf6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001919033 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001919033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001919034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001919034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001919035 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001919036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001919036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001919036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:20.001465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18136): Terminating (SIGTERM) 00:19:20.043199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18139): Terminating (SIGTERM) 00:19:20.085020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18142): Terminating (SIGTERM) 00:19:20.127158 --- ParallelTerminationStrategy: PID 18136 died... 00:19:20.147566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18136): Terminated: ok {rc=0} 00:19:20.193740 --- ParallelTerminationStrategy: PID 18139 died... 00:19:20.213499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18139): Terminated: ok {rc=0} 00:19:20.259319 --- ParallelTerminationStrategy: PID 18142 died... 00:19:20.279454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18142): Terminated: ok {rc=0} 00:19:20.366394 bus /sierra_3: Setting Powered False 00:19:21.463904 bus /sierra_3: Setting Powered False 00:19:22.578659 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:19:23.825204 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:19:23.832212 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:19:23.863636 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:19:23.890127 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:19:23.940536 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:19:23.972101 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:19:23.998835 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:19:24.550924 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:19:24.600087 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:24.611426 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:19:24.678199 tst mo_mt_call.py: using LAC 37242 00:19:24.796053 tst mo_mt_call.py: using RAC 12 00:19:24.915754 tst mo_mt_call.py: using CellId 37242 00:19:25.034549 tst mo_mt_call.py: using BVCI 37243 00:19:25.143646 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:25.154871 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:25.165779 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:25.176611 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:25.187588 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:25.198593 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:19:25.318529 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:19:25.436862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:25.931192 run create_hlr_db(pid=18148): Launched 00:19:26.053297 bus /sierra_2: Setting Powered False 00:19:27.117601 run create_hlr_db(pid=18148): Terminated: ok {rc=0} 00:19:27.545347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18150): Launched 00:19:27.843720 run osmo-hlr_10.42.42.2(pid=18151): Launched 00:19:27.957453 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:28.509710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18153): Launched 00:19:28.829394 run osmo-stp_10.42.42.5(pid=18154): Launched 00:19:28.951136 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:29.529277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18156): Launched 00:19:29.848325 run osmo-msc_10.42.42.6(pid=18157): Launched 00:19:30.026031 run osmo-stp_10.42.42.5(pid=18154): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18154)] 00:19:30.160533 run osmo-stp_10.42.42.5(pid=18154): stdout: | (launched: 2022-12-14_00:19:28.770999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:30.296537 run osmo-stp_10.42.42.5(pid=18154): stderr: | [0;m[38;5;43m20221214001928965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001928965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001928965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001928966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001928966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001928966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001928966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:30.431541 run osmo-stp_10.42.42.5(pid=18154): stdout: | (launched: 2022-12-14_00:19:28.770999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:30.559106 run osmo-stp_10.42.42.5(pid=18154): stderr: | [0;m[38;5;43m20221214001928965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001928965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001928965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001928966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001928966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001928966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001928966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:30.711387 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18154): Process ended prematurely: osmo-stp_10.42.42.5(pid=18154) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18154)] [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:19:30.720779 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:19:30.748355 run osmo-hlr_10.42.42.2(pid=18151): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18151)] 00:19:30.798512 run osmo-hlr_10.42.42.2(pid=18151): stdout: | (launched: 2022-12-14_00:19:27.789095) 00:19:30.863185 run osmo-hlr_10.42.42.2(pid=18151): stderr: | [0;m[1;31m20221214001927963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001927963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001927963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001927963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001927963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001927963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001927975 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001927984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001927984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001927984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:30.936500 run osmo-msc_10.42.42.6(pid=18157): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18157)] 00:19:30.986458 run osmo-msc_10.42.42.6(pid=18157): stdout: | (launched: 2022-12-14_00:19:29.790339) 00:19:31.038865 run osmo-msc_10.42.42.6(pid=18157): stderr: | [0;m[38;5;43m20221214001930110 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001930111 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb7eb01cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001930111 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001930111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001930111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001930111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001930113 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001930113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001930113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001930113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:31.091439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18150): Terminating (SIGTERM) 00:19:31.134154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18153): Terminating (SIGTERM) 00:19:31.177867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18156): Terminating (SIGTERM) 00:19:31.220687 --- ParallelTerminationStrategy: PID 18150 died... 00:19:31.240879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18150): Terminated: ok {rc=0} 00:19:31.288201 --- ParallelTerminationStrategy: PID 18153 died... 00:19:31.308434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18153): Terminated: ok {rc=0} 00:19:31.355585 --- ParallelTerminationStrategy: PID 18156 died... 00:19:31.376045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18156): Terminated: ok {rc=0} 00:19:31.464208 bus /sierra_3: Setting Powered False 00:19:32.562112 bus /sierra_3: Setting Powered False 00:19:33.674610 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:19:34.822143 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:34.834552 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:19:34.903166 tst mo_mt_call_osmux.py: using LAC 37243 00:19:35.027557 tst mo_mt_call_osmux.py: using RAC 13 00:19:35.152514 tst mo_mt_call_osmux.py: using CellId 37243 00:19:35.280600 tst mo_mt_call_osmux.py: using BVCI 37244 00:19:35.397928 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:35.409671 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:35.421170 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:35.432519 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:35.444433 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:35.456215 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:19:35.573350 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:19:35.688537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:36.151553 run create_hlr_db(pid=18159): Launched 00:19:36.274415 bus /sierra_2: Setting Powered False 00:19:37.334261 run create_hlr_db(pid=18159): Terminated: ok {rc=0} 00:19:37.771619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18161): Launched 00:19:38.092061 run osmo-hlr_10.42.42.2(pid=18162): Launched 00:19:38.214281 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:38.765877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18164): Launched 00:19:39.085477 run osmo-stp_10.42.42.5(pid=18165): Launched 00:19:39.207174 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:39.785601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18167): Launched 00:19:40.105442 run osmo-msc_10.42.42.6(pid=18168): Launched 00:19:40.284134 run osmo-stp_10.42.42.5(pid=18165): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18165)] 00:19:40.419518 run osmo-stp_10.42.42.5(pid=18165): stdout: | (launched: 2022-12-14_00:19:39.027278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:40.555207 run osmo-stp_10.42.42.5(pid=18165): stderr: | [0;m[38;5;43m20221214001939220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001939220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001939220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001939221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001939221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001939221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001939221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:40.689831 run osmo-stp_10.42.42.5(pid=18165): stdout: | (launched: 2022-12-14_00:19:39.027278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:40.817337 run osmo-stp_10.42.42.5(pid=18165): stderr: | [0;m[38;5;43m20221214001939220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001939220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001939220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001939221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001939221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001939221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001939221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:40.969653 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18165): Process ended prematurely: osmo-stp_10.42.42.5(pid=18165) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18165)] [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:19:40.979194 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:19:41.006877 run osmo-hlr_10.42.42.2(pid=18162): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18162)] 00:19:41.057783 run osmo-hlr_10.42.42.2(pid=18162): stdout: | (launched: 2022-12-14_00:19:38.033694) 00:19:41.109788 run osmo-hlr_10.42.42.2(pid=18162): stderr: | [0;m[1;31m20221214001938233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001938233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001938233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001938233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001938233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001938233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001938246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001938255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001938255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001938255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:41.182250 run osmo-msc_10.42.42.6(pid=18168): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18168)] 00:19:41.231963 run osmo-msc_10.42.42.6(pid=18168): stdout: | (launched: 2022-12-14_00:19:40.046835) 00:19:41.284231 run osmo-msc_10.42.42.6(pid=18168): stderr: | [0;m[38;5;43m20221214001940368 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001940368 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f18ca651c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001940368 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001940368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001940368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001940368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001940370 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001940370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001940371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001940371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:41.336564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18161): Terminating (SIGTERM) 00:19:41.378223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18164): Terminating (SIGTERM) 00:19:41.419822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18167): Terminating (SIGTERM) 00:19:41.461773 --- ParallelTerminationStrategy: PID 18161 died... 00:19:41.482227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18161): Terminated: ok {rc=0} 00:19:41.528369 --- ParallelTerminationStrategy: PID 18164 died... 00:19:41.548276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18164): Terminated: ok {rc=0} 00:19:41.594167 --- ParallelTerminationStrategy: PID 18167 died... 00:19:41.614003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18167): Terminated: ok {rc=0} 00:19:41.701682 bus /sierra_3: Setting Powered False 00:19:42.799322 bus /sierra_3: Setting Powered False 00:19:43.916145 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:19:45.168544 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:19:45.176514 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:19:45.210429 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:19:45.238041 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:19:45.295359 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:19:45.328598 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:19:45.356478 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:19:45.941126 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:19:45.991299 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:46.003725 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:19:46.073287 tst mo_mt_call.py: using LAC 37244 00:19:46.192563 tst mo_mt_call.py: using RAC 14 00:19:46.336793 tst mo_mt_call.py: using CellId 37244 00:19:46.464148 tst mo_mt_call.py: using BVCI 37245 00:19:46.592431 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:46.604694 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:46.616735 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:46.628764 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:46.641201 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:46.653052 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:19:46.773366 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:19:46.922852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:47.441657 run create_hlr_db(pid=18173): Launched 00:19:47.564373 bus /sierra_2: Setting Powered False 00:19:48.628314 run create_hlr_db(pid=18173): Terminated: ok {rc=0} 00:19:49.055890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18175): Launched 00:19:49.355071 run osmo-hlr_10.42.42.2(pid=18176): Launched 00:19:49.468279 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:49.996725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18178): Launched 00:19:50.296176 run osmo-stp_10.42.42.5(pid=18179): Launched 00:19:50.410736 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:50.951380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18181): Launched 00:19:51.250511 run osmo-msc_10.42.42.6(pid=18182): Launched 00:19:51.416827 run osmo-stp_10.42.42.5(pid=18179): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18179)] 00:19:51.547247 run osmo-stp_10.42.42.5(pid=18179): stdout: | (launched: 2022-12-14_00:19:50.241116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:51.674829 run osmo-stp_10.42.42.5(pid=18179): stderr: | [0;m[38;5;43m20221214001950410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001950410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001950410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001950411 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001950411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001950411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001950411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:51.799163 run osmo-stp_10.42.42.5(pid=18179): stdout: | (launched: 2022-12-14_00:19:50.241116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:51.918300 run osmo-stp_10.42.42.5(pid=18179): stderr: | [0;m[38;5;43m20221214001950410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214001950410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214001950410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214001950411 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214001950411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214001950411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214001950411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:52.060385 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18179): Process ended prematurely: osmo-stp_10.42.42.5(pid=18179) [trial-2396↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18179)] [trial-2396↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:19:52.069195 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:19:52.095322 run osmo-hlr_10.42.42.2(pid=18176): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18176)] 00:19:52.142713 run osmo-hlr_10.42.42.2(pid=18176): stdout: | (launched: 2022-12-14_00:19:49.300274) 00:19:52.191549 run osmo-hlr_10.42.42.2(pid=18176): stderr: | [0;m[1;31m20221214001949476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001949476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001949476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001949476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001949476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001949476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001949488 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001949498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001949499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001949499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:52.260169 run osmo-msc_10.42.42.6(pid=18182): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18182)] 00:19:52.307481 run osmo-msc_10.42.42.6(pid=18182): stdout: | (launched: 2022-12-14_00:19:51.195605) 00:19:52.356278 run osmo-msc_10.42.42.6(pid=18182): stderr: | [0;m[38;5;43m20221214001951469 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214001951469 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa57aac6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214001951469 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214001951469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214001951469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214001951470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214001951471 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214001951472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214001951472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214001951472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:52.405381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18175): Terminating (SIGTERM) 00:19:52.444430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18178): Terminating (SIGTERM) 00:19:52.483427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18181): Terminating (SIGTERM) 00:19:52.523287 --- ParallelTerminationStrategy: PID 18175 died... 00:19:52.542291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18175): Terminated: ok {rc=0} 00:19:52.586053 --- ParallelTerminationStrategy: PID 18178 died... 00:19:52.604325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18178): Terminated: ok {rc=0} 00:19:52.647791 --- ParallelTerminationStrategy: PID 18181 died... 00:19:52.666284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18181): Terminated: ok {rc=0} 00:19:52.748834 bus /sierra_3: Setting Powered False 00:19:53.846701 bus /sierra_3: Setting Powered False 00:19:54.961513 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:19:56.108787 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:56.121391 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:19:56.190764 tst mo_mt_call_osmux.py: using LAC 37245 00:19:56.316101 tst mo_mt_call_osmux.py: using RAC 15 00:19:56.446166 tst mo_mt_call_osmux.py: using CellId 37245 00:19:56.571387 tst mo_mt_call_osmux.py: using BVCI 37246 00:19:56.687444 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:56.699189 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:56.710753 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:56.722332 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:56.734257 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:56.746138 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:19:56.862267 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:19:56.982626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:57.479805 run create_hlr_db(pid=18184): Launched 00:19:57.601200 bus /sierra_2: Setting Powered False 00:19:58.664601 run create_hlr_db(pid=18184): Terminated: ok {rc=0} 00:19:59.093135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18186): Launched 00:19:59.394058 run osmo-hlr_10.42.42.2(pid=18187): Launched 00:19:59.508491 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:00.023142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18189): Launched 00:20:00.321650 run osmo-stp_10.42.42.5(pid=18190): Launched 00:20:00.435493 run osmo-msc_10.42.42.6: Starting osmo-msc 00:20:01.007416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18192): Launched 00:20:01.364258 run osmo-msc_10.42.42.6(pid=18196): Launched 00:20:01.581733 run osmo-stp_10.42.42.5(pid=18190): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18190)] 00:20:01.949100 run osmo-stp_10.42.42.5(pid=18190): stdout: | (launched: 2022-12-14_00:20:00.266885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:02.249638 run osmo-stp_10.42.42.5(pid=18190): stderr: | [0;m[38;5;43m20221214002000435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002000435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002000436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002000436 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002000438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002000439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002000439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:02.396119 run osmo-stp_10.42.42.5(pid=18190): stdout: | (launched: 2022-12-14_00:20:00.266885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:02.530035 run osmo-stp_10.42.42.5(pid=18190): stderr: | [0;m[38;5;43m20221214002000435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002000435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002000436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002000436 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002000438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002000439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002000439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:02.684328 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18190): Process ended prematurely: osmo-stp_10.42.42.5(pid=18190) [trial-2396↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18190)] [trial-2396↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:20:02.693951 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 00:20:02.721718 run osmo-hlr_10.42.42.2(pid=18187): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18187)] 00:20:02.773477 run osmo-hlr_10.42.42.2(pid=18187): stdout: | (launched: 2022-12-14_00:19:59.338821) 00:20:02.826101 run osmo-hlr_10.42.42.2(pid=18187): stderr: | [0;m[1;31m20221214001959517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214001959517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214001959517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214001959517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214001959517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214001959517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214001959530 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214001959539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214001959539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214001959539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:02.899521 run osmo-msc_10.42.42.6(pid=18196): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18196)] 00:20:02.949572 run osmo-msc_10.42.42.6(pid=18196): stdout: | (launched: 2022-12-14_00:20:01.297117) 00:20:03.002482 run osmo-msc_10.42.42.6(pid=18196): stderr: | [0;m[38;5;43m20221214002001877 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002001878 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3348f6ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002001878 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002001879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002001880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002001880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002001885 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002001886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002001886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002001887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:03.054704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18186): Terminating (SIGTERM) 00:20:03.097153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18189): Terminating (SIGTERM) 00:20:03.139934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18192): Terminating (SIGTERM) 00:20:03.183225 --- ParallelTerminationStrategy: PID 18186 died... 00:20:03.204332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18186): Terminated: ok {rc=0} 00:20:03.251337 --- ParallelTerminationStrategy: PID 18189 died... 00:20:03.271870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18189): Terminated: ok {rc=0} 00:20:03.319066 --- ParallelTerminationStrategy: PID 18192 died... 00:20:03.339621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18192): Terminated: ok {rc=0} 00:20:03.428301 bus /sierra_3: Setting Powered False 00:20:04.526437 bus /sierra_3: Setting Powered False 00:20:05.641160 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 00:20:06.892859 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:20:06.900392 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 00:20:06.933252 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 00:20:06.961279 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 00:20:07.014740 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 00:20:07.048004 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 00:20:07.076193 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 00:20:07.626033 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 00:20:07.679888 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:07.691645 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:20:07.741845 tst mo_mt_call.py: using LAC 37246 00:20:07.867360 tst mo_mt_call.py: using RAC 16 00:20:07.993375 tst mo_mt_call.py: using CellId 37246 00:20:08.118611 tst mo_mt_call.py: using BVCI 37247 00:20:08.236218 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:08.248248 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:08.259883 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:08.271461 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:08.283492 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:08.296155 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 00:20:08.413462 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 00:20:08.535302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:09.031321 run create_hlr_db(pid=18202): Launched 00:20:09.152859 bus /sierra_2: Setting Powered False 00:20:10.216330 run create_hlr_db(pid=18202): Terminated: ok {rc=0} 00:20:10.645473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18204): Launched 00:20:10.943373 run osmo-hlr_10.42.42.2(pid=18205): Launched 00:20:11.056526 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:11.588648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18207): Launched 00:20:11.887504 run osmo-stp_10.42.42.5(pid=18208): Launched 00:20:12.000816 run osmo-msc_10.42.42.6: Starting osmo-msc 00:20:12.540474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18210): Launched 00:20:12.839647 run osmo-msc_10.42.42.6(pid=18211): Launched 00:20:13.011291 run osmo-stp_10.42.42.5(pid=18208): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18208)] 00:20:13.138001 run osmo-stp_10.42.42.5(pid=18208): stdout: | (launched: 2022-12-14_00:20:11.832269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:13.264581 run osmo-stp_10.42.42.5(pid=18208): stderr: | [0;m[38;5;43m20221214002012002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002012002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002012002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002012003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002012003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002012003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002012003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:13.388902 run osmo-stp_10.42.42.5(pid=18208): stdout: | (launched: 2022-12-14_00:20:11.832269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:13.507780 run osmo-stp_10.42.42.5(pid=18208): stderr: | [0;m[38;5;43m20221214002012002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002012002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002012002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002012003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002012003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002012003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002012003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:13.650116 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18208): Process ended prematurely: osmo-stp_10.42.42.5(pid=18208) [trial-2396↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18208)] [trial-2396↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 00:20:13.658697 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 00:20:13.684781 run osmo-hlr_10.42.42.2(pid=18205): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18205)] 00:20:13.731925 run osmo-hlr_10.42.42.2(pid=18205): stdout: | (launched: 2022-12-14_00:20:10.888814) 00:20:13.781168 run osmo-hlr_10.42.42.2(pid=18205): stderr: | [0;m[1;31m20221214002011067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002011067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002011067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002011067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002011067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002011067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002011080 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002011090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002011090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002011090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:13.849706 run osmo-msc_10.42.42.6(pid=18211): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18211)] 00:20:13.896788 run osmo-msc_10.42.42.6(pid=18211): stdout: | (launched: 2022-12-14_00:20:12.784614) 00:20:13.945466 run osmo-msc_10.42.42.6(pid=18211): stderr: | [0;m[38;5;43m20221214002013054 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002013054 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6a95e4dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002013055 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002013055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002013055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002013056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002013058 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002013058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002013058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002013058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:13.994606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18204): Terminating (SIGTERM) 00:20:14.033697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18207): Terminating (SIGTERM) 00:20:14.072541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18210): Terminating (SIGTERM) 00:20:14.112015 --- ParallelTerminationStrategy: PID 18204 died... 00:20:14.131050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18204): Terminated: ok {rc=0} 00:20:14.174433 --- ParallelTerminationStrategy: PID 18207 died... 00:20:14.192839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18207): Terminated: ok {rc=0} 00:20:14.235968 --- ParallelTerminationStrategy: PID 18210 died... 00:20:14.254429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18210): Terminated: ok {rc=0} 00:20:14.339670 bus /sierra_3: Setting Powered False 00:20:15.436452 bus /sierra_3: Setting Powered False 00:20:16.559449 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 00:20:17.711061 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:17.722933 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:20:17.776482 tst mo_mt_call_osmux.py: using LAC 37247 00:20:17.894287 tst mo_mt_call_osmux.py: using RAC 17 00:20:18.011673 tst mo_mt_call_osmux.py: using CellId 37247 00:20:18.128295 tst mo_mt_call_osmux.py: using BVCI 37248 00:20:18.236649 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:18.248087 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:18.259356 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:18.270552 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:18.281836 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:18.292885 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 00:20:18.413520 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 00:20:18.531392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:18.994892 run create_hlr_db(pid=18213): Launched 00:20:19.116584 bus /sierra_2: Setting Powered False 00:20:20.177097 run create_hlr_db(pid=18213): Terminated: ok {rc=0} 00:20:20.595631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18215): Launched 00:20:20.894208 run osmo-hlr_10.42.42.2(pid=18216): Launched 00:20:21.007155 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:21.521477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18218): Launched 00:20:21.821842 run osmo-stp_10.42.42.5(pid=18219): Launched 00:20:21.935842 run osmo-msc_10.42.42.6: Starting osmo-msc 00:20:22.477703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18221): Launched 00:20:22.777672 run osmo-msc_10.42.42.6(pid=18222): Launched 00:20:22.945200 run osmo-stp_10.42.42.5(pid=18219): ERR: Terminated: ERROR {rc=1} [trial-2396↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18219)] 00:20:23.071517 run osmo-stp_10.42.42.5(pid=18219): stdout: | (launched: 2022-12-14_00:20:21.766776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:23.198032 run osmo-stp_10.42.42.5(pid=18219): stderr: | [0;m[38;5;43m20221214002021938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002021938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002021938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002021938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002021939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002021939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002021939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:23.323651 run osmo-stp_10.42.42.5(pid=18219): stdout: | (launched: 2022-12-14_00:20:21.766776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:23.443454 run osmo-stp_10.42.42.5(pid=18219): stderr: | [0;m[38;5;43m20221214002021938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002021938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002021938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002021938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002021939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002021939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002021939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:23.586467 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18219): Process ended prematurely: osmo-stp_10.42.42.5(pid=18219) [trial-2396↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18219)] [trial-2396↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 00:20:23.595117 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 00:20:23.621315 run osmo-hlr_10.42.42.2(pid=18216): ERR: Terminated: ERROR {rc=237} [trial-2396↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18216)] 00:20:23.668370 run osmo-hlr_10.42.42.2(pid=18216): stdout: | (launched: 2022-12-14_00:20:20.839379) 00:20:23.717385 run osmo-hlr_10.42.42.2(pid=18216): stderr: | [0;m[1;31m20221214002021016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002021016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002021016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002021016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002021016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002021016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002021028 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002021038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002021038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002021038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:23.785919 run osmo-msc_10.42.42.6(pid=18222): ERR: Terminated: ERROR {rc=2} [trial-2396↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18222)] 00:20:23.833194 run osmo-msc_10.42.42.6(pid=18222): stdout: | (launched: 2022-12-14_00:20:22.722568) 00:20:23.881918 run osmo-msc_10.42.42.6(pid=18222): stderr: | [0;m[38;5;43m20221214002022994 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002022994 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbeacbb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002022994 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002022994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002022995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002022995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002022997 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002022997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002022997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002022997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:23.931137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18215): Terminating (SIGTERM) 00:20:23.970178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18218): Terminating (SIGTERM) 00:20:24.009424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18221): Terminating (SIGTERM) 00:20:24.049446 --- ParallelTerminationStrategy: PID 18215 died... 00:20:24.068465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18215): Terminated: ok {rc=0} 00:20:24.112347 --- ParallelTerminationStrategy: PID 18218 died... 00:20:24.130985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18218): Terminated: ok {rc=0} 00:20:24.174849 --- ParallelTerminationStrategy: PID 18221 died... 00:20:24.193553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18221): Terminated: ok {rc=0} 00:20:24.276786 bus /sierra_3: Setting Powered False 00:20:25.373801 bus /sierra_3: Setting Powered False 00:20:26.490082 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 emergency:nanobts+band-900 --------------------------------------------------------------------- 00:20:27.751115 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:20:27.756727 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:20:27.789575 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 00:20:27.818385 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 00:20:27.904888 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:20:27.937337 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 00:20:27.964927 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 00:20:28.551458 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2396 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 00:20:28.556629 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:28.567819 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 00:20:28.617578 tst emergency_mo_mt_call.py: using LAC 37248 00:20:28.743066 tst emergency_mo_mt_call.py: using RAC 18 00:20:28.866235 tst emergency_mo_mt_call.py: using CellId 37248 00:20:28.989394 tst emergency_mo_mt_call.py: using BVCI 37249 00:20:29.105292 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:29.116469 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:29.127561 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:29.138718 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:29.150533 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:29.162823 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:29.281068 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:29.393988 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:29.849542 run create_hlr_db(pid=18229): Launched 00:20:29.970216 bus /sierra_2: Setting Powered False 00:20:31.033591 run create_hlr_db(pid=18229): Terminated: ok {rc=0} 00:20:31.522853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18231): Launched 00:20:31.830921 run osmo-hlr_10.42.42.2(pid=18232): Launched 00:20:32.124240 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:32.738356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18234): Launched 00:20:33.052694 run osmo-stp_10.42.42.5(pid=18235): Launched 00:20:33.182810 tst emergency_mo_mt_call.py: using MSISDN 8401 00:20:33.345718 run osmo-msc_10.42.42.6: Starting osmo-msc 00:20:33.911074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18237): Launched 00:20:34.224572 run osmo-msc_10.42.42.6(pid=18238): Launched 00:20:34.401266 run osmo-stp_10.42.42.5(pid=18235): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18235)] 00:20:34.534808 run osmo-stp_10.42.42.5(pid=18235): stdout: | (launched: 2022-12-14_00:20:32.995639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:34.668806 run osmo-stp_10.42.42.5(pid=18235): stderr: | [0;m[38;5;43m20221214002033187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002033187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002033188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002033188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002033189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002033189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002033189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:34.802071 run osmo-stp_10.42.42.5(pid=18235): stdout: | (launched: 2022-12-14_00:20:32.995639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:34.927605 run osmo-stp_10.42.42.5(pid=18235): stderr: | [0;m[38;5;43m20221214002033187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002033187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002033188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002033188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002033189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002033189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002033189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:35.077810 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18235): Process ended prematurely: osmo-stp_10.42.42.5(pid=18235) [trial-2396↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18235)] [trial-2396↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 00:20:35.086642 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 00:20:35.113747 run osmo-hlr_10.42.42.2(pid=18232): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18232)] 00:20:35.164148 run osmo-hlr_10.42.42.2(pid=18232): stdout: | (launched: 2022-12-14_00:20:31.772510) 00:20:35.215592 run osmo-hlr_10.42.42.2(pid=18232): stderr: | [0;m[1;31m20221214002032038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002032038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002032038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002032038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002032038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002032038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002032059 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002032074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002032075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002032075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:35.287294 run osmo-msc_10.42.42.6(pid=18238): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18238)] 00:20:35.336920 run osmo-msc_10.42.42.6(pid=18238): stdout: | (launched: 2022-12-14_00:20:34.167203) 00:20:35.388189 run osmo-msc_10.42.42.6(pid=18238): stderr: | [0;m[38;5;43m20221214002034488 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002034489 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0158a8dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002034489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002034489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002034489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002034489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002034491 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002034491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002034492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002034492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:35.439726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18231): Terminating (SIGTERM) 00:20:35.481271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18234): Terminating (SIGTERM) 00:20:35.522517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18237): Terminating (SIGTERM) 00:20:35.564402 --- ParallelTerminationStrategy: PID 18231 died... 00:20:35.584651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18231): Terminated: ok {rc=0} 00:20:35.630324 --- ParallelTerminationStrategy: PID 18234 died... 00:20:35.649806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18234): Terminated: ok {rc=0} 00:20:35.695368 --- ParallelTerminationStrategy: PID 18237 died... 00:20:35.714953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18237): Terminated: ok {rc=0} 00:20:35.801826 bus /sierra_3: Setting Powered False 00:20:36.900017 bus /sierra_3: Setting Powered False 00:20:38.016112 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 00:20:39.102125 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:39.113554 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 00:20:39.160894 tst emergency_preemptive_call.py: using LAC 37249 00:20:39.278373 tst emergency_preemptive_call.py: using RAC 19 00:20:39.394614 tst emergency_preemptive_call.py: using CellId 37249 00:20:39.508711 tst emergency_preemptive_call.py: using BVCI 37250 00:20:39.614987 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:39.625840 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:39.636213 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:39.646663 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:39.657176 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:39.668028 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:39.781959 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:39.901558 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:40.017427 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:40.135590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:40.595285 run create_hlr_db(pid=18240): Launched 00:20:40.715028 bus /sierra_2: Setting Powered False 00:20:41.774589 run create_hlr_db(pid=18240): Terminated: ok {rc=0} 00:20:42.216333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18242): Launched 00:20:42.531547 run osmo-hlr_10.42.42.2(pid=18243): Launched 00:20:42.651836 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:43.195289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18245): Launched 00:20:43.509281 run osmo-stp_10.42.42.5(pid=18246): Launched 00:20:43.639259 tst emergency_preemptive_call.py: using MSISDN 8402 00:20:43.801904 run osmo-msc_10.42.42.6: Starting osmo-msc 00:20:44.365678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18248): Launched 00:20:44.679574 run osmo-msc_10.42.42.6(pid=18249): Launched 00:20:44.855060 run osmo-stp_10.42.42.5(pid=18246): ERR: Terminated: ERROR {rc=1} [trial-2396↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18246)] 00:20:44.988028 run osmo-stp_10.42.42.5(pid=18246): stdout: | (launched: 2022-12-14_00:20:43.452090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:45.122651 run osmo-stp_10.42.42.5(pid=18246): stderr: | [0;m[38;5;43m20221214002043644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002043644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002043645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002043645 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002043646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002043646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002043646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:45.255448 run osmo-stp_10.42.42.5(pid=18246): stdout: | (launched: 2022-12-14_00:20:43.452090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:45.381205 run osmo-stp_10.42.42.5(pid=18246): stderr: | [0;m[38;5;43m20221214002043644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002043644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002043645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002043645 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002043646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002043646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002043646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:45.531213 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18246): Process ended prematurely: osmo-stp_10.42.42.5(pid=18246) [trial-2396↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18246)] [trial-2396↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 00:20:45.540200 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 00:20:45.567640 run osmo-hlr_10.42.42.2(pid=18243): ERR: Terminated: ERROR {rc=237} [trial-2396↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18243)] 00:20:45.618145 run osmo-hlr_10.42.42.2(pid=18243): stdout: | (launched: 2022-12-14_00:20:42.473933) 00:20:45.669965 run osmo-hlr_10.42.42.2(pid=18243): stderr: | [0;m[1;31m20221214002042671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002042671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002042671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002042671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002042671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002042671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002042684 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002042693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002042693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002042693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:45.742445 run osmo-msc_10.42.42.6(pid=18249): ERR: Terminated: ERROR {rc=2} [trial-2396↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18249)] 00:20:45.792040 run osmo-msc_10.42.42.6(pid=18249): stdout: | (launched: 2022-12-14_00:20:44.622184) 00:20:45.848850 run osmo-msc_10.42.42.6(pid=18249): stderr: | [0;m[38;5;43m20221214002044942 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002044942 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f599b5f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002044942 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002044942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002044943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002044943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002044944 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002044945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002044945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002044945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:45.914843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18242): Terminating (SIGTERM) 00:20:45.967010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18245): Terminating (SIGTERM) 00:20:46.010857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18248): Terminating (SIGTERM) 00:20:46.053897 --- ParallelTerminationStrategy: PID 18242 died... 00:20:46.074464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18242): Terminated: ok {rc=0} 00:20:46.122138 --- ParallelTerminationStrategy: PID 18245 died... 00:20:46.142867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18245): Terminated: ok {rc=0} 00:20:46.190277 --- ParallelTerminationStrategy: PID 18248 died... 00:20:46.210830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18248): Terminated: ok {rc=0} 00:20:46.300107 bus /sierra_9: Setting Powered False 00:20:47.397521 bus /sierra_9: Setting Powered False 00:20:48.512162 bus /sierra_8: Setting Powered False 00:20:49.610258 bus /sierra_8: Setting Powered False 00:20:50.723791 bus /sierra_3: Setting Powered False 00:20:51.820936 bus /sierra_3: Setting Powered False 00:20:52.936003 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-900 --------------------------------------------------------------------- 00:20:54.218597 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:20:54.224069 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:20:54.256587 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 00:20:54.296572 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 00:20:54.386146 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:20:54.418844 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 00:20:54.458201 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 00:20:55.051040 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 00:20:55.103694 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:55.114838 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:20:55.162937 tst cs_paging_gprs_active.py: using LAC 37250 00:20:55.289972 tst cs_paging_gprs_active.py: using RAC 20 00:20:55.417350 tst cs_paging_gprs_active.py: using CellId 37250 00:20:55.543367 tst cs_paging_gprs_active.py: using BVCI 37251 00:20:55.662701 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:55.674314 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:55.685252 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:55.696190 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:55.707352 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:55.718657 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:55.730106 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:55.741268 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:55.752125 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:55.869196 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:55.992062 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:20:56.210139 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:20:56.533476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18255): Launched 00:20:56.813341 run iperf3-srv_10.42.42.10(pid=18256): Launched 00:20:56.933757 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:20:57.150741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:20:57.474678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18257): Launched 00:20:57.754314 run iperf3-srv_10.42.42.10(pid=18258): Launched 00:20:57.874495 tst cs_paging_gprs_active.py:38: start network... 00:20:58.091180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:58.588596 run create_hlr_db(pid=18259): Launched 00:20:58.710727 bus /sierra_2: Setting Powered False 00:20:59.774334 run create_hlr_db(pid=18259): Terminated: ok {rc=0} 00:21:00.220460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18261): Launched 00:21:00.541657 run osmo-hlr_10.42.42.2(pid=18262): Launched 00:21:00.665074 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:01.204098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18264): Launched 00:21:01.574119 run osmo-stp_10.42.42.5(pid=18265): Launched 00:21:01.732421 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:21:02.424705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18267): Launched 00:21:02.554503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:21:02.825489 run patchelf(pid=18268): Launched 00:21:03.003554 run osmo-stp_10.42.42.5(pid=18265): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18265)] 00:21:03.139084 run osmo-stp_10.42.42.5(pid=18265): stdout: | (launched: 2022-12-14_00:21:01.499142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:03.276725 run osmo-stp_10.42.42.5(pid=18265): stderr: | [0;m[38;5;43m20221214002101864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002101864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002101864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002101871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002101872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002101872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002101872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:03.414934 run osmo-stp_10.42.42.5(pid=18265): stdout: | (launched: 2022-12-14_00:21:01.499142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:03.546358 run osmo-stp_10.42.42.5(pid=18265): stderr: | [0;m[38;5;43m20221214002101864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002101864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002101864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002101871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002101872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002101872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002101872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:03.702259 run patchelf(pid=18268): Terminating (SIGINT) 00:21:03.882238 run patchelf(pid=18268): Terminated: ok {rc=0} 00:21:04.011996 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18265): Process ended prematurely: osmo-stp_10.42.42.5(pid=18265) [trial-2396↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18265)] [trial-2396↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 00:21:04.022026 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 00:21:04.050325 run osmo-hlr_10.42.42.2(pid=18262): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18262)] 00:21:04.100445 run osmo-hlr_10.42.42.2(pid=18262): stdout: | (launched: 2022-12-14_00:21:00.483170) 00:21:04.152108 run osmo-hlr_10.42.42.2(pid=18262): stderr: | [0;m[1;31m20221214002100682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002100682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002100682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002100682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002100682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002100682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002100694 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002100702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002100703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002100703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:04.204289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18255): Terminating (SIGTERM) 00:21:04.246007 run iperf3-srv_10.42.42.10(pid=18256): Terminating (SIGTERM) 00:21:04.287608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18257): Terminating (SIGTERM) 00:21:04.330111 run iperf3-srv_10.42.42.10(pid=18258): Terminating (SIGTERM) 00:21:04.371808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18261): Terminating (SIGTERM) 00:21:04.413992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18264): Terminating (SIGTERM) 00:21:04.455935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18267): Terminating (SIGTERM) 00:21:04.498440 --- ParallelTerminationStrategy: PID 18255 died... 00:21:04.518601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18255): Terminated: ok {rc=0} 00:21:04.564577 --- ParallelTerminationStrategy: PID 18256 died... 00:21:04.584151 run iperf3-srv_10.42.42.10(pid=18256): Terminated {rc=256} 00:21:04.630271 --- ParallelTerminationStrategy: PID 18257 died... 00:21:04.649990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18257): Terminated: ok {rc=0} 00:21:04.695737 --- ParallelTerminationStrategy: PID 18258 died... 00:21:04.715400 run iperf3-srv_10.42.42.10(pid=18258): Terminated {rc=256} 00:21:04.761161 --- ParallelTerminationStrategy: PID 18261 died... 00:21:04.780697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18261): Terminated: ok {rc=0} 00:21:04.826337 --- ParallelTerminationStrategy: PID 18264 died... 00:21:04.846180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18264): Terminated: ok {rc=0} 00:21:04.892461 --- ParallelTerminationStrategy: PID 18267 died... 00:21:04.912460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18267): Terminated: ok {rc=0} 00:21:05.000098 bus /gobi_0: Setting Powered False 00:21:06.098595 bus /gobi_0: Setting Powered False 00:21:07.214659 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 00:21:08.363911 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:08.375893 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:21:08.426455 tst iperf3.py: using LAC 37251 00:21:08.551530 tst iperf3.py: using RAC 21 00:21:08.678471 tst iperf3.py: using CellId 37251 00:21:08.803455 tst iperf3.py: using BVCI 37252 00:21:08.919648 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:08.930937 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:08.941985 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:08.952861 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:08.964098 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:08.975324 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:08.986819 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:08.998090 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:09.009513 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:09.125707 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:21:09.328325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:09.630688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18269): Launched 00:21:09.893126 run iperf3-srv_10.42.42.10(pid=18270): Launched 00:21:10.006148 tst iperf3.py:8: start network... 00:21:10.208578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:10.675434 run create_hlr_db(pid=18271): Launched 00:21:10.799541 bus /gobi_6: Setting Powered False 00:21:11.860276 run create_hlr_db(pid=18271): Terminated: ok {rc=0} 00:21:12.299976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18273): Launched 00:21:12.621535 run osmo-hlr_10.42.42.2(pid=18274): Launched 00:21:12.743757 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:13.298919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18276): Launched 00:21:13.620167 run osmo-stp_10.42.42.5(pid=18277): Launched 00:21:13.743005 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:21:14.294920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18279): Launched 00:21:14.417682 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:21:14.688030 run patchelf(pid=18280): Launched 00:21:14.866564 run osmo-stp_10.42.42.5(pid=18277): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18277)] 00:21:15.002913 run osmo-stp_10.42.42.5(pid=18277): stdout: | (launched: 2022-12-14_00:21:13.561926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:15.141085 run osmo-stp_10.42.42.5(pid=18277): stderr: | [0;m[38;5;43m20221214002113754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002113754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002113754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002113755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002113755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002113755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002113755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:15.279292 run osmo-stp_10.42.42.5(pid=18277): stdout: | (launched: 2022-12-14_00:21:13.561926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:15.411769 run osmo-stp_10.42.42.5(pid=18277): stderr: | [0;m[38;5;43m20221214002113754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002113754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002113754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002113755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002113755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002113755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002113755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:15.568297 run patchelf(pid=18280): Terminating (SIGINT) 00:21:15.749607 run patchelf(pid=18280): Terminated: ok {rc=0} 00:21:15.886676 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18277): Process ended prematurely: osmo-stp_10.42.42.5(pid=18277) [trial-2396↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18277)] [trial-2396↪gprs:nanobts+band-900↪iperf3.py:8] 00:21:15.897545 tst iperf3.py:8: Test FAILED (7.6 sec) 00:21:15.940011 run osmo-hlr_10.42.42.2(pid=18274): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18274)] 00:21:15.992335 run osmo-hlr_10.42.42.2(pid=18274): stdout: | (launched: 2022-12-14_00:21:12.562938) 00:21:16.052465 run osmo-hlr_10.42.42.2(pid=18274): stderr: | [0;m[1;31m20221214002112761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002112761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002112761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002112761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002112761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002112762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002112774 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002112782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002112783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002112783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:16.110113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18269): Terminating (SIGTERM) 00:21:16.153786 run iperf3-srv_10.42.42.10(pid=18270): Terminating (SIGTERM) 00:21:16.200858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18273): Terminating (SIGTERM) 00:21:16.245703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18276): Terminating (SIGTERM) 00:21:16.290488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18279): Terminating (SIGTERM) 00:21:16.336939 --- ParallelTerminationStrategy: PID 18269 died... 00:21:16.359103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18269): Terminated: ok {rc=0} 00:21:16.408173 --- ParallelTerminationStrategy: PID 18270 died... 00:21:16.429776 run iperf3-srv_10.42.42.10(pid=18270): Terminated {rc=256} 00:21:16.478495 --- ParallelTerminationStrategy: PID 18273 died... 00:21:16.500521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18273): Terminated: ok {rc=0} 00:21:16.549229 --- ParallelTerminationStrategy: PID 18276 died... 00:21:16.570951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18276): Terminated: ok {rc=0} 00:21:16.619758 --- ParallelTerminationStrategy: PID 18279 died... 00:21:16.641718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18279): Terminated: ok {rc=0} 00:21:16.733910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 00:21:17.886764 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:17.898394 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:21:17.947852 tst iperf3m4.py: using LAC 37252 00:21:18.068220 tst iperf3m4.py: using RAC 22 00:21:18.188868 tst iperf3m4.py: using CellId 37252 00:21:18.307444 tst iperf3m4.py: using BVCI 37253 00:21:18.418025 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:18.428838 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:18.439522 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:18.449993 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:18.460400 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:18.471463 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:18.482352 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:18.493419 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:18.504118 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:18.619632 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:18.740307 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:18.857101 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:18.974270 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:21:19.177141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:19.479153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18281): Launched 00:21:19.740736 run iperf3-srv_10.42.42.10(pid=18282): Launched 00:21:19.854497 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:21:20.055577 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:20.357683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18283): Launched 00:21:20.619023 run iperf3-srv_10.42.42.10(pid=18284): Launched 00:21:20.731509 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:21:20.932626 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:21.234556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18285): Launched 00:21:21.496611 run iperf3-srv_10.42.42.10(pid=18286): Launched 00:21:21.609366 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:21:21.811838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:22.115260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18287): Launched 00:21:22.377432 run iperf3-srv_10.42.42.10(pid=18288): Launched 00:21:22.490241 tst iperf3m4.py:8: start network... 00:21:22.691877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:23.158454 run create_hlr_db(pid=18289): Launched 00:21:23.281441 bus /gobi_6: Setting Powered False 00:21:24.342328 run create_hlr_db(pid=18289): Terminated: ok {rc=0} 00:21:24.783679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18291): Launched 00:21:25.107027 run osmo-hlr_10.42.42.2(pid=18292): Launched 00:21:25.230626 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:25.787169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18294): Launched 00:21:26.110346 run osmo-stp_10.42.42.5(pid=18295): Launched 00:21:26.233403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:21:26.789357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18297): Launched 00:21:26.912494 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:21:27.185097 run patchelf(pid=18298): Launched 00:21:27.364447 run osmo-stp_10.42.42.5(pid=18295): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18295)] 00:21:27.501392 run osmo-stp_10.42.42.5(pid=18295): stdout: | (launched: 2022-12-14_00:21:26.051370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:27.639775 run osmo-stp_10.42.42.5(pid=18295): stderr: | [0;m[38;5;43m20221214002126244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002126245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002126245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002126245 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002126246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002126246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002126246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:27.778644 run osmo-stp_10.42.42.5(pid=18295): stdout: | (launched: 2022-12-14_00:21:26.051370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:27.911390 run osmo-stp_10.42.42.5(pid=18295): stderr: | [0;m[38;5;43m20221214002126244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002126245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002126245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002126245 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002126246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002126246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002126246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:28.068088 run patchelf(pid=18298): Terminating (SIGINT) 00:21:28.250416 run patchelf(pid=18298): Terminated: ok {rc=0} 00:21:28.381822 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18295): Process ended prematurely: osmo-stp_10.42.42.5(pid=18295) [trial-2396↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18295)] [trial-2396↪gprs:nanobts+band-900↪iperf3m4.py:8] 00:21:28.392022 tst iperf3m4.py:8: Test FAILED (10.5 sec) 00:21:28.420861 run osmo-hlr_10.42.42.2(pid=18292): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18292)] 00:21:28.471936 run osmo-hlr_10.42.42.2(pid=18292): stdout: | (launched: 2022-12-14_00:21:25.048164) 00:21:28.524333 run osmo-hlr_10.42.42.2(pid=18292): stderr: | [0;m[1;31m20221214002125245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002125245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002125246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002125246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002125246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002125246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002125261 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002125269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002125269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002125269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:28.577629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18281): Terminating (SIGTERM) 00:21:28.619438 run iperf3-srv_10.42.42.10(pid=18282): Terminating (SIGTERM) 00:21:28.661734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18283): Terminating (SIGTERM) 00:21:28.703997 run iperf3-srv_10.42.42.10(pid=18284): Terminating (SIGTERM) 00:21:28.746380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18285): Terminating (SIGTERM) 00:21:28.788581 run iperf3-srv_10.42.42.10(pid=18286): Terminating (SIGTERM) 00:21:28.831015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18287): Terminating (SIGTERM) 00:21:28.873347 run iperf3-srv_10.42.42.10(pid=18288): Terminating (SIGTERM) 00:21:28.915453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18291): Terminating (SIGTERM) 00:21:28.957815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18294): Terminating (SIGTERM) 00:21:28.999954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18297): Terminating (SIGTERM) 00:21:29.042470 --- ParallelTerminationStrategy: PID 18281 died... 00:21:29.063167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18281): Terminated: ok {rc=0} 00:21:29.110141 --- ParallelTerminationStrategy: PID 18282 died... 00:21:29.130165 run iperf3-srv_10.42.42.10(pid=18282): Terminated {rc=256} 00:21:29.176814 --- ParallelTerminationStrategy: PID 18283 died... 00:21:29.197405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18283): Terminated: ok {rc=0} 00:21:29.243794 --- ParallelTerminationStrategy: PID 18284 died... 00:21:29.263644 run iperf3-srv_10.42.42.10(pid=18284): Terminated {rc=256} 00:21:29.309914 --- ParallelTerminationStrategy: PID 18285 died... 00:21:29.330047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18285): Terminated: ok {rc=0} 00:21:29.376529 --- ParallelTerminationStrategy: PID 18286 died... 00:21:29.396624 run iperf3-srv_10.42.42.10(pid=18286): Terminated {rc=256} 00:21:29.442886 --- ParallelTerminationStrategy: PID 18287 died... 00:21:29.462820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18287): Terminated: ok {rc=0} 00:21:29.509253 --- ParallelTerminationStrategy: PID 18288 died... 00:21:29.529124 run iperf3-srv_10.42.42.10(pid=18288): Terminated {rc=256} 00:21:29.575505 --- ParallelTerminationStrategy: PID 18291 died... 00:21:29.595603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18291): Terminated: ok {rc=0} 00:21:29.642082 --- ParallelTerminationStrategy: PID 18294 died... 00:21:29.662194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18294): Terminated: ok {rc=0} 00:21:29.708738 --- ParallelTerminationStrategy: PID 18297 died... 00:21:29.728908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18297): Terminated: ok {rc=0} 00:21:29.816501 bus /gobi_4: Setting Powered False 00:21:30.923917 bus /gobi_4: Setting Powered False 00:21:32.073078 bus /gobi_1: Setting Powered False 00:21:33.182023 bus /gobi_1: Setting Powered False 00:21:34.296530 bus /gobi_0: Setting Powered False 00:21:35.396596 bus /gobi_0: Setting Powered False 00:21:36.510886 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900 ping.py ---------------------------------------------- 00:21:37.613817 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:37.625498 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:21:37.677556 tst ping.py: using LAC 37253 00:21:37.793443 tst ping.py: using RAC 23 00:21:37.916296 tst ping.py: using CellId 37253 00:21:38.039011 tst ping.py: using BVCI 37254 00:21:38.154098 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:38.165575 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:38.176752 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:38.188184 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:38.199593 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:38.211009 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:38.222715 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:38.234073 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:38.352483 tst ping.py:19: start network... 00:21:38.566151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:39.053889 run create_hlr_db(pid=18299): Launched 00:21:39.173439 bus /gobi_6: Setting Powered False 00:21:40.236260 run create_hlr_db(pid=18299): Terminated: ok {rc=0} 00:21:40.676800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18301): Launched 00:21:40.991374 run osmo-hlr_10.42.42.2(pid=18302): Launched 00:21:41.111513 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:41.657204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18304): Launched 00:21:41.971847 run osmo-stp_10.42.42.5(pid=18305): Launched 00:21:42.092743 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:21:42.637791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18307): Launched 00:21:42.758168 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:21:43.024709 run patchelf(pid=18308): Launched 00:21:43.199925 run osmo-stp_10.42.42.5(pid=18305): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18305)] 00:21:43.333987 run osmo-stp_10.42.42.5(pid=18305): stdout: | (launched: 2022-12-14_00:21:41.914535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:43.469920 run osmo-stp_10.42.42.5(pid=18305): stderr: | [0;m[38;5;43m20221214002142107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002142108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002142108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002142108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002142109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002142109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002142109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:43.604915 run osmo-stp_10.42.42.5(pid=18305): stdout: | (launched: 2022-12-14_00:21:41.914535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:43.734914 run osmo-stp_10.42.42.5(pid=18305): stderr: | [0;m[38;5;43m20221214002142107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002142108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002142108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002142108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002142109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002142109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002142109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:43.888581 run patchelf(pid=18308): Terminating (SIGINT) 00:21:44.066291 run patchelf(pid=18308): Terminated: ok {rc=0} 00:21:44.193391 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18305): Process ended prematurely: osmo-stp_10.42.42.5(pid=18305) [trial-2396↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18305)] [trial-2396↪gprs:nanobts+band-900↪ping.py:22] 00:21:44.202790 tst ping.py:22: Test FAILED (6.6 sec) 00:21:44.231054 run osmo-hlr_10.42.42.2(pid=18302): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18302)] 00:21:44.282000 run osmo-hlr_10.42.42.2(pid=18302): stdout: | (launched: 2022-12-14_00:21:40.934007) 00:21:44.334773 run osmo-hlr_10.42.42.2(pid=18302): stderr: | [0;m[1;31m20221214002141131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002141131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002141131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002141131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002141131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002141131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002141144 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002141153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002141153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002141153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:44.387675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18301): Terminating (SIGTERM) 00:21:44.429885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18304): Terminating (SIGTERM) 00:21:44.472527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18307): Terminating (SIGTERM) 00:21:44.515489 --- ParallelTerminationStrategy: PID 18301 died... 00:21:44.536165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18301): Terminated: ok {rc=0} 00:21:44.582973 --- ParallelTerminationStrategy: PID 18304 died... 00:21:44.603234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18304): Terminated: ok {rc=0} 00:21:44.649748 --- ParallelTerminationStrategy: PID 18307 died... 00:21:44.669818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18307): Terminated: ok {rc=0} 00:21:44.758318 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 00:21:45.861676 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:45.885185 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:21:45.936863 tst ping_idle_ping.py: using LAC 37254 00:21:46.067776 tst ping_idle_ping.py: using RAC 24 00:21:46.196584 tst ping_idle_ping.py: using CellId 37254 00:21:46.350151 tst ping_idle_ping.py: using BVCI 37255 00:21:46.477237 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:46.489350 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:46.501481 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:46.513485 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:46.526632 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:46.539688 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:46.552820 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:46.565991 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:46.689658 tst ping_idle_ping.py:24: start network... 00:21:46.907356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:47.405939 run create_hlr_db(pid=18309): Launched 00:21:47.528202 bus /gobi_6: Setting Powered False 00:21:48.591889 run create_hlr_db(pid=18309): Terminated: ok {rc=0} 00:21:49.035864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18311): Launched 00:21:49.353124 run osmo-hlr_10.42.42.2(pid=18312): Launched 00:21:49.474697 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:50.022628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18314): Launched 00:21:50.338942 run osmo-stp_10.42.42.5(pid=18315): Launched 00:21:50.460373 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:21:51.007319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18317): Launched 00:21:51.128661 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:21:51.396332 run patchelf(pid=18318): Launched 00:21:51.571862 run osmo-stp_10.42.42.5(pid=18315): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18315)] 00:21:51.705959 run osmo-stp_10.42.42.5(pid=18315): stdout: | (launched: 2022-12-14_00:21:50.281082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:51.841671 run osmo-stp_10.42.42.5(pid=18315): stderr: | [0;m[38;5;43m20221214002150474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002150474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002150474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002150475 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002150475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002150475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002150475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:51.978043 run osmo-stp_10.42.42.5(pid=18315): stdout: | (launched: 2022-12-14_00:21:50.281082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:52.108063 run osmo-stp_10.42.42.5(pid=18315): stderr: | [0;m[38;5;43m20221214002150474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002150474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002150474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002150475 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002150475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002150475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002150475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:52.261982 run patchelf(pid=18318): Terminating (SIGINT) 00:21:52.439891 run patchelf(pid=18318): Terminated: ok {rc=0} 00:21:52.567598 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18315): Process ended prematurely: osmo-stp_10.42.42.5(pid=18315) [trial-2396↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18315)] [trial-2396↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 00:21:52.576884 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 00:21:52.605080 run osmo-hlr_10.42.42.2(pid=18312): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18312)] 00:21:52.655705 run osmo-hlr_10.42.42.2(pid=18312): stdout: | (launched: 2022-12-14_00:21:49.294819) 00:21:52.708314 run osmo-hlr_10.42.42.2(pid=18312): stderr: | [0;m[1;31m20221214002149494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002149494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002149494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002149494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002149494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002149494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002149507 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002149515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002149515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002149515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:52.761206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18311): Terminating (SIGTERM) 00:21:52.803028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18314): Terminating (SIGTERM) 00:21:52.845721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18317): Terminating (SIGTERM) 00:21:52.888456 --- ParallelTerminationStrategy: PID 18311 died... 00:21:52.908872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18311): Terminated: ok {rc=0} 00:21:52.955866 --- ParallelTerminationStrategy: PID 18314 died... 00:21:52.975933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18314): Terminated: ok {rc=0} 00:21:53.022524 --- ParallelTerminationStrategy: PID 18317 died... 00:21:53.042593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18317): Terminated: ok {rc=0} 00:21:53.131061 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 00:21:54.434092 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:21:54.440617 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:21:54.472339 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:21:54.510705 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:21:54.596415 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:21:54.627981 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:21:54.665839 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:21:55.265619 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:21:55.314028 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.324817 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:21:55.375153 tst cs_paging_gprs_active.py: using LAC 37255 00:21:55.501858 tst cs_paging_gprs_active.py: using RAC 25 00:21:55.628600 tst cs_paging_gprs_active.py: using CellId 37255 00:21:55.748791 tst cs_paging_gprs_active.py: using BVCI 37256 00:21:55.858371 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.869553 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.880323 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.891157 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.902015 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.912564 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.923815 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.934541 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.945494 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:21:56.065898 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:21:56.185415 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:21:56.404213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:56.728092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18322): Launched 00:21:57.008498 run iperf3-srv_10.42.42.10(pid=18323): Launched 00:21:57.129529 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:21:57.347942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:57.672184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18324): Launched 00:21:57.952590 run iperf3-srv_10.42.42.10(pid=18325): Launched 00:21:58.073534 tst cs_paging_gprs_active.py:38: start network... 00:21:58.291318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:58.790873 run create_hlr_db(pid=18326): Launched 00:21:58.914140 bus /gobi_6: Setting Powered False 00:21:59.978389 run create_hlr_db(pid=18326): Terminated: ok {rc=0} 00:22:00.411043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18328): Launched 00:22:00.714491 run osmo-hlr_10.42.42.2(pid=18329): Launched 00:22:00.845224 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:01.542756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18331): Launched 00:22:01.897913 run osmo-stp_10.42.42.5(pid=18332): Launched 00:22:02.132582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:02.719059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18334): Launched 00:22:02.843311 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:03.116065 run patchelf(pid=18335): Launched 00:22:03.294809 run osmo-stp_10.42.42.5(pid=18332): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18332)] 00:22:03.431519 run osmo-stp_10.42.42.5(pid=18332): stdout: | (launched: 2022-12-14_00:22:01.831308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:03.569728 run osmo-stp_10.42.42.5(pid=18332): stderr: | [0;m[38;5;43m20221214002202092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002202092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002202092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002202094 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002202094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002202095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002202095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:03.707662 run osmo-stp_10.42.42.5(pid=18332): stdout: | (launched: 2022-12-14_00:22:01.831308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:03.839656 run osmo-stp_10.42.42.5(pid=18332): stderr: | [0;m[38;5;43m20221214002202092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002202092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002202092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002202094 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002202094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002202095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002202095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:03.996183 run patchelf(pid=18335): Terminating (SIGINT) 00:22:04.176593 run patchelf(pid=18335): Terminated: ok {rc=0} 00:22:04.306915 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18332): Process ended prematurely: osmo-stp_10.42.42.5(pid=18332) [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18332)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:22:04.317090 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 00:22:04.345560 run osmo-hlr_10.42.42.2(pid=18329): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18329)] 00:22:04.395868 run osmo-hlr_10.42.42.2(pid=18329): stdout: | (launched: 2022-12-14_00:22:00.659376) 00:22:04.447746 run osmo-hlr_10.42.42.2(pid=18329): stderr: | [0;m[1;31m20221214002200834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002200834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002200834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002200834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002200834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002200834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002200858 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002200873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002200873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002200874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:04.499847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18322): Terminating (SIGTERM) 00:22:04.541397 run iperf3-srv_10.42.42.10(pid=18323): Terminating (SIGTERM) 00:22:04.582827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18324): Terminating (SIGTERM) 00:22:04.624165 run iperf3-srv_10.42.42.10(pid=18325): Terminating (SIGTERM) 00:22:04.665989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18328): Terminating (SIGTERM) 00:22:04.708004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18331): Terminating (SIGTERM) 00:22:04.749968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18334): Terminating (SIGTERM) 00:22:04.792158 --- ParallelTerminationStrategy: PID 18322 died... 00:22:04.812344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18322): Terminated: ok {rc=0} 00:22:04.858133 --- ParallelTerminationStrategy: PID 18323 died... 00:22:04.878057 run iperf3-srv_10.42.42.10(pid=18323): Terminated {rc=256} 00:22:04.923608 --- ParallelTerminationStrategy: PID 18324 died... 00:22:04.943486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18324): Terminated: ok {rc=0} 00:22:04.989279 --- ParallelTerminationStrategy: PID 18325 died... 00:22:05.008638 run iperf3-srv_10.42.42.10(pid=18325): Terminated {rc=256} 00:22:05.054398 --- ParallelTerminationStrategy: PID 18328 died... 00:22:05.074112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18328): Terminated: ok {rc=0} 00:22:05.119875 --- ParallelTerminationStrategy: PID 18331 died... 00:22:05.139363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18331): Terminated: ok {rc=0} 00:22:05.185382 --- ParallelTerminationStrategy: PID 18334 died... 00:22:05.205064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18334): Terminated: ok {rc=0} 00:22:05.292214 bus /gobi_0: Setting Powered False 00:22:06.390445 bus /gobi_0: Setting Powered False 00:22:07.506490 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:22:08.654448 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:08.666351 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:22:08.722000 tst iperf3.py: using LAC 37256 00:22:08.848450 tst iperf3.py: using RAC 26 00:22:08.974293 tst iperf3.py: using CellId 37256 00:22:09.098851 tst iperf3.py: using BVCI 37257 00:22:09.215374 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:09.226885 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:09.238253 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:09.249450 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:09.260785 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:09.272547 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:09.284168 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:09.295493 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:09.307199 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:09.428078 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:22:09.631401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:09.934324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18336): Launched 00:22:10.197721 run iperf3-srv_10.42.42.10(pid=18337): Launched 00:22:10.312161 tst iperf3.py:8: start network... 00:22:10.515856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:10.983517 run create_hlr_db(pid=18338): Launched 00:22:11.107064 bus /gobi_6: Setting Powered False 00:22:12.167723 run create_hlr_db(pid=18338): Terminated: ok {rc=0} 00:22:12.609427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18340): Launched 00:22:12.931762 run osmo-hlr_10.42.42.2(pid=18341): Launched 00:22:13.054958 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:13.612509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18343): Launched 00:22:13.933415 run osmo-stp_10.42.42.5(pid=18344): Launched 00:22:14.056388 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:14.612248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18346): Launched 00:22:14.735852 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:15.008605 run patchelf(pid=18347): Launched 00:22:15.187426 run osmo-stp_10.42.42.5(pid=18344): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18344)] 00:22:15.323958 run osmo-stp_10.42.42.5(pid=18344): stdout: | (launched: 2022-12-14_00:22:13.874847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:15.462491 run osmo-stp_10.42.42.5(pid=18344): stderr: | [0;m[38;5;43m20221214002214066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002214067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002214067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002214067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002214068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002214068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002214068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:15.600893 run osmo-stp_10.42.42.5(pid=18344): stdout: | (launched: 2022-12-14_00:22:13.874847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:15.732794 run osmo-stp_10.42.42.5(pid=18344): stderr: | [0;m[38;5;43m20221214002214066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002214067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002214067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002214067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002214068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002214068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002214068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:15.919444 run patchelf(pid=18347): Terminating (SIGINT) 00:22:16.104589 run patchelf(pid=18347): Terminated: ok {rc=0} 00:22:16.237831 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18344): Process ended prematurely: osmo-stp_10.42.42.5(pid=18344) [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18344)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 00:22:16.248796 tst iperf3.py:8: Test FAILED (7.6 sec) 00:22:16.278786 run osmo-hlr_10.42.42.2(pid=18341): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18341)] 00:22:16.332497 run osmo-hlr_10.42.42.2(pid=18341): stdout: | (launched: 2022-12-14_00:22:12.873245) 00:22:16.387228 run osmo-hlr_10.42.42.2(pid=18341): stderr: | [0;m[1;31m20221214002213074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002213074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002213074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002213074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002213074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002213074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002213086 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002213095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002213095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002213095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:16.442161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18336): Terminating (SIGTERM) 00:22:16.485956 run iperf3-srv_10.42.42.10(pid=18337): Terminating (SIGTERM) 00:22:16.532618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18340): Terminating (SIGTERM) 00:22:16.577403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18343): Terminating (SIGTERM) 00:22:16.623144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18346): Terminating (SIGTERM) 00:22:16.667560 --- ParallelTerminationStrategy: PID 18336 died... 00:22:16.688831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18336): Terminated: ok {rc=0} 00:22:16.737525 --- ParallelTerminationStrategy: PID 18337 died... 00:22:16.758802 run iperf3-srv_10.42.42.10(pid=18337): Terminated {rc=256} 00:22:16.807248 --- ParallelTerminationStrategy: PID 18340 died... 00:22:16.828792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18340): Terminated: ok {rc=0} 00:22:16.877091 --- ParallelTerminationStrategy: PID 18343 died... 00:22:16.898391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18343): Terminated: ok {rc=0} 00:22:16.946626 --- ParallelTerminationStrategy: PID 18346 died... 00:22:16.967986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18346): Terminated: ok {rc=0} 00:22:17.059482 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:22:18.210343 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:18.222499 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:22:18.272277 tst iperf3m4.py: using LAC 37257 00:22:18.400265 tst iperf3m4.py: using RAC 27 00:22:18.528095 tst iperf3m4.py: using CellId 37257 00:22:18.654031 tst iperf3m4.py: using BVCI 37258 00:22:18.773232 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:18.784659 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:18.796086 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:18.807260 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:18.818808 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:18.830436 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:18.842057 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:18.853578 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:18.865158 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:18.986238 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:19.107415 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:19.225498 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:19.341426 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:22:19.544520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:19.847491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18349): Launched 00:22:20.110092 run iperf3-srv_10.42.42.10(pid=18350): Launched 00:22:20.223330 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:22:20.425857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:20.729660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18351): Launched 00:22:20.992121 run iperf3-srv_10.42.42.10(pid=18352): Launched 00:22:21.104891 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:22:21.306175 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:21.608262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18353): Launched 00:22:21.871033 run iperf3-srv_10.42.42.10(pid=18354): Launched 00:22:21.984065 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:22:22.185641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:22.488637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18355): Launched 00:22:22.751030 run iperf3-srv_10.42.42.10(pid=18356): Launched 00:22:22.863645 tst iperf3m4.py:8: start network... 00:22:23.064492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:23.528528 run create_hlr_db(pid=18357): Launched 00:22:23.652648 bus /gobi_6: Setting Powered False 00:22:24.713482 run create_hlr_db(pid=18357): Terminated: ok {rc=0} 00:22:25.152052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18359): Launched 00:22:25.473563 run osmo-hlr_10.42.42.2(pid=18360): Launched 00:22:25.597842 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:26.151990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18362): Launched 00:22:26.474572 run osmo-stp_10.42.42.5(pid=18363): Launched 00:22:26.598019 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:27.151977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18365): Launched 00:22:27.275026 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:27.548230 run patchelf(pid=18366): Launched 00:22:27.727173 run osmo-stp_10.42.42.5(pid=18363): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18363)] 00:22:27.863358 run osmo-stp_10.42.42.5(pid=18363): stdout: | (launched: 2022-12-14_00:22:26.415735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:28.001485 run osmo-stp_10.42.42.5(pid=18363): stderr: | [0;m[38;5;43m20221214002226606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002226607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002226607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002226607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002226608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002226608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002226608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:28.139374 run osmo-stp_10.42.42.5(pid=18363): stdout: | (launched: 2022-12-14_00:22:26.415735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:28.271385 run osmo-stp_10.42.42.5(pid=18363): stderr: | [0;m[38;5;43m20221214002226606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002226607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002226607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002226607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002226608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002226608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002226608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:28.428514 run patchelf(pid=18366): Terminating (SIGINT) 00:22:28.609154 run patchelf(pid=18366): Terminated: ok {rc=0} 00:22:28.739274 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18363): Process ended prematurely: osmo-stp_10.42.42.5(pid=18363) [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18363)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 00:22:28.749696 tst iperf3m4.py:8: Test FAILED (10.6 sec) 00:22:28.778707 run osmo-hlr_10.42.42.2(pid=18360): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18360)] 00:22:28.830018 run osmo-hlr_10.42.42.2(pid=18360): stdout: | (launched: 2022-12-14_00:22:25.414804) 00:22:28.881485 run osmo-hlr_10.42.42.2(pid=18360): stderr: | [0;m[1;31m20221214002225613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002225613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002225613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002225613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002225614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002225614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002225625 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002225634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002225635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002225635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:28.933644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18349): Terminating (SIGTERM) 00:22:28.975699 run iperf3-srv_10.42.42.10(pid=18350): Terminating (SIGTERM) 00:22:29.017944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18351): Terminating (SIGTERM) 00:22:29.059866 run iperf3-srv_10.42.42.10(pid=18352): Terminating (SIGTERM) 00:22:29.101877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18353): Terminating (SIGTERM) 00:22:29.143669 run iperf3-srv_10.42.42.10(pid=18354): Terminating (SIGTERM) 00:22:29.186082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18355): Terminating (SIGTERM) 00:22:29.227678 run iperf3-srv_10.42.42.10(pid=18356): Terminating (SIGTERM) 00:22:29.269624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18359): Terminating (SIGTERM) 00:22:29.311472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18362): Terminating (SIGTERM) 00:22:29.352879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18365): Terminating (SIGTERM) 00:22:29.395162 --- ParallelTerminationStrategy: PID 18349 died... 00:22:29.415582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18349): Terminated: ok {rc=0} 00:22:29.461608 --- ParallelTerminationStrategy: PID 18350 died... 00:22:29.481374 run iperf3-srv_10.42.42.10(pid=18350): Terminated {rc=256} 00:22:29.527270 --- ParallelTerminationStrategy: PID 18351 died... 00:22:29.547026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18351): Terminated: ok {rc=0} 00:22:29.592830 --- ParallelTerminationStrategy: PID 18352 died... 00:22:29.612899 run iperf3-srv_10.42.42.10(pid=18352): Terminated {rc=256} 00:22:29.658546 --- ParallelTerminationStrategy: PID 18353 died... 00:22:29.678670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18353): Terminated: ok {rc=0} 00:22:29.724550 --- ParallelTerminationStrategy: PID 18354 died... 00:22:29.744254 run iperf3-srv_10.42.42.10(pid=18354): Terminated {rc=256} 00:22:29.789983 --- ParallelTerminationStrategy: PID 18355 died... 00:22:29.809698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18355): Terminated: ok {rc=0} 00:22:29.855628 --- ParallelTerminationStrategy: PID 18356 died... 00:22:29.875402 run iperf3-srv_10.42.42.10(pid=18356): Terminated {rc=256} 00:22:29.921286 --- ParallelTerminationStrategy: PID 18359 died... 00:22:29.940836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18359): Terminated: ok {rc=0} 00:22:29.986973 --- ParallelTerminationStrategy: PID 18362 died... 00:22:30.006708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18362): Terminated: ok {rc=0} 00:22:30.052613 --- ParallelTerminationStrategy: PID 18365 died... 00:22:30.072540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18365): Terminated: ok {rc=0} 00:22:30.159880 bus /gobi_4: Setting Powered False 00:22:31.257488 bus /gobi_4: Setting Powered False 00:22:32.384068 bus /gobi_1: Setting Powered False 00:22:33.482824 bus /gobi_1: Setting Powered False 00:22:34.597944 bus /gobi_0: Setting Powered False 00:22:35.696409 bus /gobi_0: Setting Powered False 00:22:36.811783 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 00:22:37.915679 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:37.927736 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:22:37.977763 tst ping.py: using LAC 37258 00:22:38.107052 tst ping.py: using RAC 28 00:22:38.230933 tst ping.py: using CellId 37258 00:22:38.353361 tst ping.py: using BVCI 37259 00:22:38.469030 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:38.480696 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:38.492273 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:38.503529 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:38.514975 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:38.526578 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:38.538226 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:38.549812 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:38.667065 tst ping.py:19: start network... 00:22:38.879969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:39.367814 run create_hlr_db(pid=18368): Launched 00:22:39.488045 bus /gobi_6: Setting Powered False 00:22:40.550509 run create_hlr_db(pid=18368): Terminated: ok {rc=0} 00:22:40.974710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18370): Launched 00:22:41.270566 run osmo-hlr_10.42.42.2(pid=18371): Launched 00:22:41.383648 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:41.911899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18373): Launched 00:22:42.207077 run osmo-stp_10.42.42.5(pid=18374): Launched 00:22:42.318895 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:42.829465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18376): Launched 00:22:42.942523 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:43.192839 run patchelf(pid=18377): Launched 00:22:43.357505 run osmo-stp_10.42.42.5(pid=18374): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18374)] 00:22:43.482762 run osmo-stp_10.42.42.5(pid=18374): stdout: | (launched: 2022-12-14_00:22:42.152332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:43.609404 run osmo-stp_10.42.42.5(pid=18374): stderr: | [0;m[38;5;43m20221214002242323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002242323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002242323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002242323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002242324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002242324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002242324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:43.736490 run osmo-stp_10.42.42.5(pid=18374): stdout: | (launched: 2022-12-14_00:22:42.152332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:43.858005 run osmo-stp_10.42.42.5(pid=18374): stderr: | [0;m[38;5;43m20221214002242323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002242323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002242323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002242323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002242324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002242324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002242324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:44.001947 run patchelf(pid=18377): Terminating (SIGINT) 00:22:44.168219 run patchelf(pid=18377): Terminated: ok {rc=0} 00:22:44.287305 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18374): Process ended prematurely: osmo-stp_10.42.42.5(pid=18374) [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18374)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 00:22:44.296123 tst ping.py:22: Test FAILED (6.4 sec) 00:22:44.322443 run osmo-hlr_10.42.42.2(pid=18371): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18371)] 00:22:44.369487 run osmo-hlr_10.42.42.2(pid=18371): stdout: | (launched: 2022-12-14_00:22:41.215958) 00:22:44.418337 run osmo-hlr_10.42.42.2(pid=18371): stderr: | [0;m[1;31m20221214002241391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002241391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002241391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002241391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002241391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002241392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002241404 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002241414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002241414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002241414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:44.467863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18370): Terminating (SIGTERM) 00:22:44.507368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18373): Terminating (SIGTERM) 00:22:44.546531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18376): Terminating (SIGTERM) 00:22:44.586057 --- ParallelTerminationStrategy: PID 18370 died... 00:22:44.605084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18370): Terminated: ok {rc=0} 00:22:44.648567 --- ParallelTerminationStrategy: PID 18373 died... 00:22:44.667180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18373): Terminated: ok {rc=0} 00:22:44.710528 --- ParallelTerminationStrategy: PID 18376 died... 00:22:44.728989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18376): Terminated: ok {rc=0} 00:22:44.810858 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:22:45.905750 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:45.924088 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:22:45.977043 tst ping_idle_ping.py: using LAC 37259 00:22:46.117951 tst ping_idle_ping.py: using RAC 29 00:22:46.247508 tst ping_idle_ping.py: using CellId 37259 00:22:46.366582 tst ping_idle_ping.py: using BVCI 37260 00:22:46.477541 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:46.489666 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:46.501589 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:46.513331 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:46.525637 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:46.538137 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:46.550747 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:46.563037 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:46.689197 tst ping_idle_ping.py:24: start network... 00:22:46.908431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:47.412178 run create_hlr_db(pid=18378): Launched 00:22:47.534319 bus /gobi_6: Setting Powered False 00:22:48.597409 run create_hlr_db(pid=18378): Terminated: ok {rc=0} 00:22:49.023950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18380): Launched 00:22:49.320656 run osmo-hlr_10.42.42.2(pid=18381): Launched 00:22:49.433766 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:49.949188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18383): Launched 00:22:50.245572 run osmo-stp_10.42.42.5(pid=18384): Launched 00:22:50.359236 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:50.890884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18386): Launched 00:22:51.003713 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:51.254571 run patchelf(pid=18387): Launched 00:22:51.419349 run osmo-stp_10.42.42.5(pid=18384): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18384)] 00:22:51.544781 run osmo-stp_10.42.42.5(pid=18384): stdout: | (launched: 2022-12-14_00:22:50.190841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:51.671930 run osmo-stp_10.42.42.5(pid=18384): stderr: | [0;m[38;5;43m20221214002250361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002250361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002250361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002250361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002250362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002250362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002250362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:51.799527 run osmo-stp_10.42.42.5(pid=18384): stdout: | (launched: 2022-12-14_00:22:50.190841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:51.921164 run osmo-stp_10.42.42.5(pid=18384): stderr: | [0;m[38;5;43m20221214002250361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002250361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002250361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002250361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002250362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002250362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002250362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:52.065820 run patchelf(pid=18387): Terminating (SIGINT) 00:22:52.232708 run patchelf(pid=18387): Terminated: ok {rc=0} 00:22:52.352634 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18384): Process ended prematurely: osmo-stp_10.42.42.5(pid=18384) [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18384)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 00:22:52.361622 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:22:52.388334 run osmo-hlr_10.42.42.2(pid=18381): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18381)] 00:22:52.435990 run osmo-hlr_10.42.42.2(pid=18381): stdout: | (launched: 2022-12-14_00:22:49.265998) 00:22:52.485549 run osmo-hlr_10.42.42.2(pid=18381): stderr: | [0;m[1;31m20221214002249443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002249443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002249443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002249443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002249443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002249443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002249456 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002249467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002249467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002249467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:52.535803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18380): Terminating (SIGTERM) 00:22:52.575681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18383): Terminating (SIGTERM) 00:22:52.615447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18386): Terminating (SIGTERM) 00:22:52.655466 --- ParallelTerminationStrategy: PID 18380 died... 00:22:52.674700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18380): Terminated: ok {rc=0} 00:22:52.718901 --- ParallelTerminationStrategy: PID 18383 died... 00:22:52.737863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18383): Terminated: ok {rc=0} 00:22:52.781794 --- ParallelTerminationStrategy: PID 18386 died... 00:22:52.800499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18386): Terminated: ok {rc=0} 00:22:52.884550 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:22:54.191200 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:22:54.198918 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:22:54.232521 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:22:54.272170 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:22:54.360569 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:22:54.394061 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:22:54.434147 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:22:55.030812 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:22:55.083236 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:55.094717 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:22:55.162616 tst cs_paging_gprs_active.py: using LAC 37260 00:22:55.291116 tst cs_paging_gprs_active.py: using RAC 30 00:22:55.416816 tst cs_paging_gprs_active.py: using CellId 37260 00:22:55.541729 tst cs_paging_gprs_active.py: using BVCI 37261 00:22:55.658687 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:55.670592 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:55.682056 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:55.693432 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:55.705380 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:55.716937 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:55.728713 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:55.740345 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:55.752213 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:22:55.869218 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:22:55.989903 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:22:56.208702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:56.533397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18391): Launched 00:22:56.814596 run iperf3-srv_10.42.42.10(pid=18392): Launched 00:22:56.935617 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:22:57.153920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:57.478878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18393): Launched 00:22:57.759376 run iperf3-srv_10.42.42.10(pid=18394): Launched 00:22:57.879955 tst cs_paging_gprs_active.py:38: start network... 00:22:58.097249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:58.597607 run create_hlr_db(pid=18395): Launched 00:22:58.720123 bus /gobi_6: Setting Powered False 00:22:59.784430 run create_hlr_db(pid=18395): Terminated: ok {rc=0} 00:23:00.215343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18397): Launched 00:23:00.518932 run osmo-hlr_10.42.42.2(pid=18398): Launched 00:23:00.636243 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:01.225248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18400): Launched 00:23:01.575594 run osmo-stp_10.42.42.5(pid=18401): Launched 00:23:01.786508 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:02.410427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18403): Launched 00:23:02.535434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:02.809234 run patchelf(pid=18404): Launched 00:23:02.989104 run osmo-stp_10.42.42.5(pid=18401): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18401)] 00:23:03.125618 run osmo-stp_10.42.42.5(pid=18401): stdout: | (launched: 2022-12-14_00:23:01.501838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:03.263977 run osmo-stp_10.42.42.5(pid=18401): stderr: | [0;m[38;5;43m20221214002301719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002301719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002301719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002301720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002301720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002301720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002301720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:03.402913 run osmo-stp_10.42.42.5(pid=18401): stdout: | (launched: 2022-12-14_00:23:01.501838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:03.535192 run osmo-stp_10.42.42.5(pid=18401): stderr: | [0;m[38;5;43m20221214002301719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002301719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002301719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002301720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002301720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002301720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002301720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:03.692013 run patchelf(pid=18404): Terminating (SIGINT) 00:23:03.872808 run patchelf(pid=18404): Terminated: ok {rc=0} 00:23:04.003625 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18401): Process ended prematurely: osmo-stp_10.42.42.5(pid=18401) [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18401)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:23:04.013776 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 00:23:04.042286 run osmo-hlr_10.42.42.2(pid=18398): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18398)] 00:23:04.093284 run osmo-hlr_10.42.42.2(pid=18398): stdout: | (launched: 2022-12-14_00:23:00.463623) 00:23:04.145452 run osmo-hlr_10.42.42.2(pid=18398): stderr: | [0;m[1;31m20221214002300639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002300639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002300640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002300640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002300640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002300640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002300652 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002300663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002300663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002300663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:04.197831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18391): Terminating (SIGTERM) 00:23:04.239864 run iperf3-srv_10.42.42.10(pid=18392): Terminating (SIGTERM) 00:23:04.281831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18393): Terminating (SIGTERM) 00:23:04.323889 run iperf3-srv_10.42.42.10(pid=18394): Terminating (SIGTERM) 00:23:04.365923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18397): Terminating (SIGTERM) 00:23:04.408620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18400): Terminating (SIGTERM) 00:23:04.451139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18403): Terminating (SIGTERM) 00:23:04.493649 --- ParallelTerminationStrategy: PID 18391 died... 00:23:04.514136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18391): Terminated: ok {rc=0} 00:23:04.560614 --- ParallelTerminationStrategy: PID 18392 died... 00:23:04.580526 run iperf3-srv_10.42.42.10(pid=18392): Terminated {rc=256} 00:23:04.626872 --- ParallelTerminationStrategy: PID 18393 died... 00:23:04.646951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18393): Terminated: ok {rc=0} 00:23:04.693380 --- ParallelTerminationStrategy: PID 18394 died... 00:23:04.713155 run iperf3-srv_10.42.42.10(pid=18394): Terminated {rc=256} 00:23:04.759230 --- ParallelTerminationStrategy: PID 18397 died... 00:23:04.779146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18397): Terminated: ok {rc=0} 00:23:04.825575 --- ParallelTerminationStrategy: PID 18400 died... 00:23:04.845510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18400): Terminated: ok {rc=0} 00:23:04.891699 --- ParallelTerminationStrategy: PID 18403 died... 00:23:04.911669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18403): Terminated: ok {rc=0} 00:23:04.999529 bus /gobi_0: Setting Powered False 00:23:06.097177 bus /gobi_0: Setting Powered False 00:23:07.213791 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:23:08.357790 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:08.369435 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:23:08.439798 tst iperf3.py: using LAC 37261 00:23:08.559929 tst iperf3.py: using RAC 31 00:23:08.680886 tst iperf3.py: using CellId 37261 00:23:08.800867 tst iperf3.py: using BVCI 37262 00:23:08.910706 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:08.921706 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:08.932352 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:08.943020 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:08.954207 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:08.965539 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:08.976921 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:08.988157 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:08.999469 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:09.120255 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:23:09.337990 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:09.662067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18405): Launched 00:23:09.943784 run iperf3-srv_10.42.42.10(pid=18406): Launched 00:23:10.064917 tst iperf3.py:8: start network... 00:23:10.283047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:10.784589 run create_hlr_db(pid=18407): Launched 00:23:10.912243 bus /gobi_6: Setting Powered False 00:23:11.973391 run create_hlr_db(pid=18407): Terminated: ok {rc=0} 00:23:12.403419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18409): Launched 00:23:12.706234 run osmo-hlr_10.42.42.2(pid=18410): Launched 00:23:12.820830 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:13.338733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18412): Launched 00:23:13.639442 run osmo-stp_10.42.42.5(pid=18413): Launched 00:23:13.753612 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:14.271373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18415): Launched 00:23:14.386480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:14.641395 run patchelf(pid=18416): Launched 00:23:14.809706 run osmo-stp_10.42.42.5(pid=18413): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18413)] 00:23:14.937211 run osmo-stp_10.42.42.5(pid=18413): stdout: | (launched: 2022-12-14_00:23:13.584153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:15.066582 run osmo-stp_10.42.42.5(pid=18413): stderr: | [0;m[38;5;43m20221214002313756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002313756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002313757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002313757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002313758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002313758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002313758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:15.195894 run osmo-stp_10.42.42.5(pid=18413): stdout: | (launched: 2022-12-14_00:23:13.584153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:15.319322 run osmo-stp_10.42.42.5(pid=18413): stderr: | [0;m[38;5;43m20221214002313756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002313756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002313757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002313757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002313758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002313758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002313758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:15.465723 run patchelf(pid=18416): Terminating (SIGINT) 00:23:15.635483 run patchelf(pid=18416): Terminated: ok {rc=0} 00:23:15.757557 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18413): Process ended prematurely: osmo-stp_10.42.42.5(pid=18413) [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18413)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 00:23:15.766859 tst iperf3.py:8: Test FAILED (7.4 sec) 00:23:15.793924 run osmo-hlr_10.42.42.2(pid=18410): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18410)] 00:23:15.851441 run osmo-hlr_10.42.42.2(pid=18410): stdout: | (launched: 2022-12-14_00:23:12.650101) 00:23:15.918682 run osmo-hlr_10.42.42.2(pid=18410): stderr: | [0;m[1;31m20221214002312827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002312828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002312828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002312828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002312828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002312828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002312840 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002312849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002312850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002312850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:15.982662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18405): Terminating (SIGTERM) 00:23:16.026285 run iperf3-srv_10.42.42.10(pid=18406): Terminating (SIGTERM) 00:23:16.074355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18409): Terminating (SIGTERM) 00:23:16.119111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18412): Terminating (SIGTERM) 00:23:16.165609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18415): Terminating (SIGTERM) 00:23:16.213593 --- ParallelTerminationStrategy: PID 18405 died... 00:23:16.235636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18405): Terminated: ok {rc=0} 00:23:16.287858 --- ParallelTerminationStrategy: PID 18406 died... 00:23:16.308661 run iperf3-srv_10.42.42.10(pid=18406): Terminated {rc=256} 00:23:16.357837 --- ParallelTerminationStrategy: PID 18409 died... 00:23:16.379545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18409): Terminated: ok {rc=0} 00:23:16.429194 --- ParallelTerminationStrategy: PID 18412 died... 00:23:16.451205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18412): Terminated: ok {rc=0} 00:23:16.500910 --- ParallelTerminationStrategy: PID 18415 died... 00:23:16.523008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18415): Terminated: ok {rc=0} 00:23:16.618663 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:23:17.773659 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:17.785357 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:23:17.854094 tst iperf3m4.py: using LAC 37262 00:23:17.979649 tst iperf3m4.py: using RAC 32 00:23:18.103830 tst iperf3m4.py: using CellId 37262 00:23:18.228063 tst iperf3m4.py: using BVCI 37263 00:23:18.347062 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:18.358499 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:18.369832 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:18.381073 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:18.393533 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:18.405670 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:18.417974 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:18.430120 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:18.442435 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:18.563824 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:18.686270 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:18.804805 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:18.924589 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:23:19.144265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:19.469867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18417): Launched 00:23:19.751091 run iperf3-srv_10.42.42.10(pid=18418): Launched 00:23:19.872923 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:23:20.091776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:20.416456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18419): Launched 00:23:20.697371 run iperf3-srv_10.42.42.10(pid=18420): Launched 00:23:20.818722 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:23:21.036713 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:21.360803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18421): Launched 00:23:21.641727 run iperf3-srv_10.42.42.10(pid=18422): Launched 00:23:21.762604 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:23:21.980469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:22.305383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18423): Launched 00:23:22.586305 run iperf3-srv_10.42.42.10(pid=18424): Launched 00:23:22.707028 tst iperf3m4.py:8: start network... 00:23:22.924881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:23.424379 run create_hlr_db(pid=18425): Launched 00:23:23.547351 bus /gobi_6: Setting Powered False 00:23:24.610934 run create_hlr_db(pid=18425): Terminated: ok {rc=0} 00:23:25.060000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18427): Launched 00:23:25.382290 run osmo-hlr_10.42.42.2(pid=18428): Launched 00:23:25.506395 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:26.067259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18430): Launched 00:23:26.390485 run osmo-stp_10.42.42.5(pid=18431): Launched 00:23:26.514665 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:27.070925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18433): Launched 00:23:27.195071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:27.468161 run patchelf(pid=18434): Launched 00:23:27.646996 run osmo-stp_10.42.42.5(pid=18431): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18431)] 00:23:27.783088 run osmo-stp_10.42.42.5(pid=18431): stdout: | (launched: 2022-12-14_00:23:26.331391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:27.921374 run osmo-stp_10.42.42.5(pid=18431): stderr: | [0;m[38;5;43m20221214002326524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002326524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002326525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002326525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002326525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002326525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002326526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:28.059258 run osmo-stp_10.42.42.5(pid=18431): stdout: | (launched: 2022-12-14_00:23:26.331391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:28.191507 run osmo-stp_10.42.42.5(pid=18431): stderr: | [0;m[38;5;43m20221214002326524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002326524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002326525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002326525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002326525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002326525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002326526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:28.348221 run patchelf(pid=18434): Terminating (SIGINT) 00:23:28.530431 run patchelf(pid=18434): Terminated: ok {rc=0} 00:23:28.660669 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18431): Process ended prematurely: osmo-stp_10.42.42.5(pid=18431) [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18431)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:23:28.671019 tst iperf3m4.py:8: Test FAILED (10.9 sec) 00:23:28.699708 run osmo-hlr_10.42.42.2(pid=18428): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18428)] 00:23:28.750676 run osmo-hlr_10.42.42.2(pid=18428): stdout: | (launched: 2022-12-14_00:23:25.323409) 00:23:28.802738 run osmo-hlr_10.42.42.2(pid=18428): stderr: | [0;m[1;31m20221214002325523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002325523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002325523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002325523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002325523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002325523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002325535 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002325543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002325543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002325543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:28.855869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18417): Terminating (SIGTERM) 00:23:28.897859 run iperf3-srv_10.42.42.10(pid=18418): Terminating (SIGTERM) 00:23:28.939936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18419): Terminating (SIGTERM) 00:23:28.982307 run iperf3-srv_10.42.42.10(pid=18420): Terminating (SIGTERM) 00:23:29.024262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18421): Terminating (SIGTERM) 00:23:29.066570 run iperf3-srv_10.42.42.10(pid=18422): Terminating (SIGTERM) 00:23:29.108664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18423): Terminating (SIGTERM) 00:23:29.151298 run iperf3-srv_10.42.42.10(pid=18424): Terminating (SIGTERM) 00:23:29.193392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18427): Terminating (SIGTERM) 00:23:29.235982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18430): Terminating (SIGTERM) 00:23:29.278289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18433): Terminating (SIGTERM) 00:23:29.321460 --- ParallelTerminationStrategy: PID 18417 died... 00:23:29.341846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18417): Terminated: ok {rc=0} 00:23:29.388661 --- ParallelTerminationStrategy: PID 18418 died... 00:23:29.409053 run iperf3-srv_10.42.42.10(pid=18418): Terminated {rc=256} 00:23:29.455123 --- ParallelTerminationStrategy: PID 18419 died... 00:23:29.475048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18419): Terminated: ok {rc=0} 00:23:29.521620 --- ParallelTerminationStrategy: PID 18420 died... 00:23:29.541603 run iperf3-srv_10.42.42.10(pid=18420): Terminated {rc=256} 00:23:29.587499 --- ParallelTerminationStrategy: PID 18421 died... 00:23:29.607307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18421): Terminated: ok {rc=0} 00:23:29.653974 --- ParallelTerminationStrategy: PID 18422 died... 00:23:29.674053 run iperf3-srv_10.42.42.10(pid=18422): Terminated {rc=256} 00:23:29.720152 --- ParallelTerminationStrategy: PID 18423 died... 00:23:29.740241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18423): Terminated: ok {rc=0} 00:23:29.786912 --- ParallelTerminationStrategy: PID 18424 died... 00:23:29.806961 run iperf3-srv_10.42.42.10(pid=18424): Terminated {rc=256} 00:23:29.853033 --- ParallelTerminationStrategy: PID 18427 died... 00:23:29.872791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18427): Terminated: ok {rc=0} 00:23:29.918952 --- ParallelTerminationStrategy: PID 18430 died... 00:23:29.938966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18430): Terminated: ok {rc=0} 00:23:29.985388 --- ParallelTerminationStrategy: PID 18433 died... 00:23:30.005485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18433): Terminated: ok {rc=0} 00:23:30.094426 bus /gobi_4: Setting Powered False 00:23:31.195011 bus /gobi_4: Setting Powered False 00:23:32.308335 bus /gobi_1: Setting Powered False 00:23:33.407209 bus /gobi_1: Setting Powered False 00:23:34.523410 bus /gobi_0: Setting Powered False 00:23:35.621969 bus /gobi_0: Setting Powered False 00:23:36.739768 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:23:37.842645 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:37.854945 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:23:37.925365 tst ping.py: using LAC 37263 00:23:38.044589 tst ping.py: using RAC 33 00:23:38.162555 tst ping.py: using CellId 37263 00:23:38.278978 tst ping.py: using BVCI 37264 00:23:38.386170 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.397471 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.408431 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.419410 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.430287 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.441326 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.452294 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.463338 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:38.582627 tst ping.py:19: start network... 00:23:38.797119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:39.287064 run create_hlr_db(pid=18435): Launched 00:23:39.409078 bus /gobi_6: Setting Powered False 00:23:40.471755 run create_hlr_db(pid=18435): Terminated: ok {rc=0} 00:23:40.897529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18437): Launched 00:23:41.194615 run osmo-hlr_10.42.42.2(pid=18438): Launched 00:23:41.307285 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:41.819994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18440): Launched 00:23:42.116128 run osmo-stp_10.42.42.5(pid=18441): Launched 00:23:42.228292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:42.738557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18443): Launched 00:23:42.850854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:43.102101 run patchelf(pid=18444): Launched 00:23:43.266313 run osmo-stp_10.42.42.5(pid=18441): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18441)] 00:23:43.390871 run osmo-stp_10.42.42.5(pid=18441): stdout: | (launched: 2022-12-14_00:23:42.060633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:43.517324 run osmo-stp_10.42.42.5(pid=18441): stderr: | [0;m[38;5;43m20221214002342232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002342232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002342232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002342233 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002342233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002342234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002342234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:43.643653 run osmo-stp_10.42.42.5(pid=18441): stdout: | (launched: 2022-12-14_00:23:42.060633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:43.764529 run osmo-stp_10.42.42.5(pid=18441): stderr: | [0;m[38;5;43m20221214002342232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002342232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002342232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002342233 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002342233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002342234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002342234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:43.907787 run patchelf(pid=18444): Terminating (SIGINT) 00:23:44.073854 run patchelf(pid=18444): Terminated: ok {rc=0} 00:23:44.193504 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18441): Process ended prematurely: osmo-stp_10.42.42.5(pid=18441) [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18441)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 00:23:44.202225 tst ping.py:22: Test FAILED (6.4 sec) 00:23:44.228618 run osmo-hlr_10.42.42.2(pid=18438): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18438)] 00:23:44.275938 run osmo-hlr_10.42.42.2(pid=18438): stdout: | (launched: 2022-12-14_00:23:41.140392) 00:23:44.325264 run osmo-hlr_10.42.42.2(pid=18438): stderr: | [0;m[1;31m20221214002341317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002341317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002341317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002341317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002341317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002341317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002341329 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002341339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002341340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002341340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:44.374628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18437): Terminating (SIGTERM) 00:23:44.414174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18440): Terminating (SIGTERM) 00:23:44.453994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18443): Terminating (SIGTERM) 00:23:44.494177 --- ParallelTerminationStrategy: PID 18437 died... 00:23:44.513517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18437): Terminated: ok {rc=0} 00:23:44.557802 --- ParallelTerminationStrategy: PID 18440 died... 00:23:44.576811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18440): Terminated: ok {rc=0} 00:23:44.620833 --- ParallelTerminationStrategy: PID 18443 died... 00:23:44.639650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18443): Terminated: ok {rc=0} 00:23:44.724846 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:23:45.812933 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:45.825121 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:23:45.920555 tst ping_idle_ping.py: using LAC 37264 00:23:46.048768 tst ping_idle_ping.py: using RAC 34 00:23:46.166596 tst ping_idle_ping.py: using CellId 37264 00:23:46.301484 tst ping_idle_ping.py: using BVCI 37265 00:23:46.411296 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:46.422867 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:46.434390 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:46.445835 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:46.457407 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:46.468800 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:46.480356 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:46.491946 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:46.608269 tst ping_idle_ping.py:24: start network... 00:23:46.879686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:47.389747 run create_hlr_db(pid=18445): Launched 00:23:47.513351 bus /gobi_6: Setting Powered False 00:23:48.576867 run create_hlr_db(pid=18445): Terminated: ok {rc=0} 00:23:49.003556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18447): Launched 00:23:49.320916 run osmo-hlr_10.42.42.2(pid=18448): Launched 00:23:49.442968 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:49.991000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18450): Launched 00:23:50.307845 run osmo-stp_10.42.42.5(pid=18451): Launched 00:23:50.429193 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:50.976285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18453): Launched 00:23:51.098371 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:51.366863 run patchelf(pid=18454): Launched 00:23:51.544072 run osmo-stp_10.42.42.5(pid=18451): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18451)] 00:23:51.678613 run osmo-stp_10.42.42.5(pid=18451): stdout: | (launched: 2022-12-14_00:23:50.250038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:51.814767 run osmo-stp_10.42.42.5(pid=18451): stderr: | [0;m[38;5;43m20221214002350442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002350442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002350442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002350443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002350443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002350443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002350443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:51.950984 run osmo-stp_10.42.42.5(pid=18451): stdout: | (launched: 2022-12-14_00:23:50.250038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:52.081442 run osmo-stp_10.42.42.5(pid=18451): stderr: | [0;m[38;5;43m20221214002350442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002350442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002350442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002350443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002350443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002350443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002350443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:52.236074 run patchelf(pid=18454): Terminating (SIGINT) 00:23:52.414798 run patchelf(pid=18454): Terminated: ok {rc=0} 00:23:52.543119 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18451): Process ended prematurely: osmo-stp_10.42.42.5(pid=18451) [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18451)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:23:52.552584 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 00:23:52.580633 run osmo-hlr_10.42.42.2(pid=18448): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18448)] 00:23:52.630837 run osmo-hlr_10.42.42.2(pid=18448): stdout: | (launched: 2022-12-14_00:23:49.263277) 00:23:52.682606 run osmo-hlr_10.42.42.2(pid=18448): stderr: | [0;m[1;31m20221214002349461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002349461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002349461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002349461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002349461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002349461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002349473 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002349482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002349482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002349482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:52.734853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18447): Terminating (SIGTERM) 00:23:52.776751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18450): Terminating (SIGTERM) 00:23:52.819025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18453): Terminating (SIGTERM) 00:23:52.861462 --- ParallelTerminationStrategy: PID 18447 died... 00:23:52.882012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18447): Terminated: ok {rc=0} 00:23:52.928497 --- ParallelTerminationStrategy: PID 18450 died... 00:23:52.948524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18450): Terminated: ok {rc=0} 00:23:52.994670 --- ParallelTerminationStrategy: PID 18453 died... 00:23:53.014496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18453): Terminated: ok {rc=0} 00:23:53.102295 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 00:23:54.419113 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:23:54.426865 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 00:23:54.459239 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 00:23:54.499525 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 00:23:54.587651 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 00:23:54.620046 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 00:23:54.659124 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 00:23:55.262322 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 00:23:55.313323 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:55.324941 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:23:55.375553 tst cs_paging_gprs_active.py: using LAC 37265 00:23:55.496933 tst cs_paging_gprs_active.py: using RAC 35 00:23:55.614616 tst cs_paging_gprs_active.py: using CellId 37265 00:23:55.730346 tst cs_paging_gprs_active.py: using BVCI 37266 00:23:55.840035 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:55.851564 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:55.862779 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:55.873893 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:55.885471 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:55.896938 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:55.908753 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:55.920307 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:55.932133 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:23:56.052854 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:23:56.166983 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:23:56.367956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:56.668112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18458): Launched 00:23:56.926921 run iperf3-srv_10.42.42.10(pid=18459): Launched 00:23:57.039309 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:23:57.239353 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:57.539095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18460): Launched 00:23:57.799205 run iperf3-srv_10.42.42.10(pid=18461): Launched 00:23:57.911022 tst cs_paging_gprs_active.py:38: start network... 00:23:58.110468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:58.573003 run create_hlr_db(pid=18462): Launched 00:23:58.694733 bus /gobi_6: Setting Powered False 00:23:59.754241 run create_hlr_db(pid=18462): Terminated: ok {rc=0} 00:24:00.188860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18464): Launched 00:24:00.506586 run osmo-hlr_10.42.42.2(pid=18465): Launched 00:24:00.629419 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:01.179286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18467): Launched 00:24:01.587527 run osmo-stp_10.42.42.5(pid=18502): Launched 00:24:01.892817 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:02.591795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18530): Launched 00:24:02.733197 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:03.039351 run patchelf(pid=18549): Launched 00:24:03.234325 run osmo-stp_10.42.42.5(pid=18502): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18502)] 00:24:03.394029 run osmo-stp_10.42.42.5(pid=18502): stdout: | (launched: 2022-12-14_00:24:01.509821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:03.542833 run osmo-stp_10.42.42.5(pid=18502): stderr: | [0;m[38;5;43m20221214002401764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002401764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002401765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002401765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002401767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002401767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002401768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:03.701466 run osmo-stp_10.42.42.5(pid=18502): stdout: | (launched: 2022-12-14_00:24:01.509821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:03.851642 run osmo-stp_10.42.42.5(pid=18502): stderr: | [0;m[38;5;43m20221214002401764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002401764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002401765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002401765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002401767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002401767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002401768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:04.036020 run patchelf(pid=18549): Terminating (SIGINT) 00:24:04.243568 run patchelf(pid=18549): Terminated: ok {rc=0} 00:24:04.399109 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18502): Process ended prematurely: osmo-stp_10.42.42.5(pid=18502) [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18502)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 00:24:04.409914 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 00:24:04.446957 run osmo-hlr_10.42.42.2(pid=18465): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18465)] 00:24:04.511399 run osmo-hlr_10.42.42.2(pid=18465): stdout: | (launched: 2022-12-14_00:24:00.449038) 00:24:04.575331 run osmo-hlr_10.42.42.2(pid=18465): stderr: | [0;m[1;31m20221214002400647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002400647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002400647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002400647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002400647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002400647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002400664 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002400674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002400674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002400674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:04.637851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18458): Terminating (SIGTERM) 00:24:04.688625 run iperf3-srv_10.42.42.10(pid=18459): Terminating (SIGTERM) 00:24:04.741117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18460): Terminating (SIGTERM) 00:24:04.789545 run iperf3-srv_10.42.42.10(pid=18461): Terminating (SIGTERM) 00:24:04.838827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18464): Terminating (SIGTERM) 00:24:04.890993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18467): Terminating (SIGTERM) 00:24:04.934273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18530): Terminating (SIGTERM) 00:24:04.977195 --- ParallelTerminationStrategy: PID 18458 died... 00:24:04.997411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18458): Terminated: ok {rc=0} 00:24:05.047708 --- ParallelTerminationStrategy: PID 18459 died... 00:24:05.070765 run iperf3-srv_10.42.42.10(pid=18459): Terminated {rc=256} 00:24:05.116675 --- ParallelTerminationStrategy: PID 18460 died... 00:24:05.136077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18460): Terminated: ok {rc=0} 00:24:05.180523 --- ParallelTerminationStrategy: PID 18461 died... 00:24:05.199763 run iperf3-srv_10.42.42.10(pid=18461): Terminated {rc=256} 00:24:05.245763 --- ParallelTerminationStrategy: PID 18464 died... 00:24:05.266438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18464): Terminated: ok {rc=0} 00:24:05.311495 --- ParallelTerminationStrategy: PID 18467 died... 00:24:05.331438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18467): Terminated: ok {rc=0} 00:24:05.377110 --- ParallelTerminationStrategy: PID 18530 died... 00:24:05.397357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18530): Terminated: ok {rc=0} 00:24:05.485556 bus /gobi_0: Setting Powered False 00:24:06.583921 bus /gobi_0: Setting Powered False 00:24:07.701453 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 00:24:08.853227 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:08.867752 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:24:08.921281 tst iperf3.py: using LAC 37266 00:24:09.047844 tst iperf3.py: using RAC 36 00:24:09.175099 tst iperf3.py: using CellId 37266 00:24:09.304380 tst iperf3.py: using BVCI 37267 00:24:09.423977 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:09.436884 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:09.449675 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:09.463356 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:09.477028 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:09.490593 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:09.503951 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:09.517397 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:09.531348 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:09.654622 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:24:09.857066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:10.165960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18744): Launched 00:24:10.449706 run iperf3-srv_10.42.42.10(pid=18745): Launched 00:24:10.584534 tst iperf3.py:8: start network... 00:24:10.807539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:11.319612 run create_hlr_db(pid=18746): Launched 00:24:11.485642 bus /gobi_6: Setting Powered False 00:24:12.549511 run create_hlr_db(pid=18746): Terminated: ok {rc=0} 00:24:13.012829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18748): Launched 00:24:13.354433 run osmo-hlr_10.42.42.2(pid=18749): Launched 00:24:13.600819 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:14.274719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18751): Launched 00:24:14.617140 run osmo-stp_10.42.42.5(pid=18752): Launched 00:24:14.868165 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:15.518503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18754): Launched 00:24:15.655655 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:15.979186 run patchelf(pid=18755): Launched 00:24:16.187499 run osmo-stp_10.42.42.5(pid=18752): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18752)] 00:24:16.345734 run osmo-stp_10.42.42.5(pid=18752): stdout: | (launched: 2022-12-14_00:24:14.553797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:16.527423 run osmo-stp_10.42.42.5(pid=18752): stderr: | [0;m[38;5;43m20221214002414860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002414860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002414860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002414861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002414861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002414861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002414861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:16.699194 run osmo-stp_10.42.42.5(pid=18752): stdout: | (launched: 2022-12-14_00:24:14.553797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:16.864190 run osmo-stp_10.42.42.5(pid=18752): stderr: | [0;m[38;5;43m20221214002414860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002414860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002414860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002414861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002414861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002414861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002414861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:17.057196 run patchelf(pid=18755): Terminating (SIGINT) 00:24:17.277297 run patchelf(pid=18755): Terminated: ok {rc=0} 00:24:17.437722 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18752): Process ended prematurely: osmo-stp_10.42.42.5(pid=18752) [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18752)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 00:24:17.450204 tst iperf3.py:8: Test FAILED (8.6 sec) 00:24:17.486140 run osmo-hlr_10.42.42.2(pid=18749): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18749)] 00:24:17.549144 run osmo-hlr_10.42.42.2(pid=18749): stdout: | (launched: 2022-12-14_00:24:13.291788) 00:24:17.613444 run osmo-hlr_10.42.42.2(pid=18749): stderr: | [0;m[1;31m20221214002413605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002413605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002413605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002413605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002413605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002413605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002413627 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002413636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002413636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002413636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:17.679442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18744): Terminating (SIGTERM) 00:24:17.733140 run iperf3-srv_10.42.42.10(pid=18745): Terminating (SIGTERM) 00:24:17.782678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18748): Terminating (SIGTERM) 00:24:17.834968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18751): Terminating (SIGTERM) 00:24:17.892139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18754): Terminating (SIGTERM) 00:24:17.947790 --- ParallelTerminationStrategy: PID 18744 died... 00:24:17.972045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18744): Terminated: ok {rc=0} 00:24:18.032108 --- ParallelTerminationStrategy: PID 18745 died... 00:24:18.055745 run iperf3-srv_10.42.42.10(pid=18745): Terminated {rc=256} 00:24:18.108391 --- ParallelTerminationStrategy: PID 18748 died... 00:24:18.133383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18748): Terminated: ok {rc=0} 00:24:18.191298 --- ParallelTerminationStrategy: PID 18751 died... 00:24:18.216836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18751): Terminated: ok {rc=0} 00:24:18.274758 --- ParallelTerminationStrategy: PID 18754 died... 00:24:18.299400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18754): Terminated: ok {rc=0} 00:24:18.402092 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 00:24:19.562335 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:19.575796 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:24:19.631791 tst iperf3m4.py: using LAC 37267 00:24:19.758247 tst iperf3m4.py: using RAC 37 00:24:19.885342 tst iperf3m4.py: using CellId 37267 00:24:20.013097 tst iperf3m4.py: using BVCI 37268 00:24:20.131655 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:20.144501 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:20.157507 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:20.170281 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:20.184075 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:20.197813 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:20.211820 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:20.225249 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:20.238847 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:20.365533 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:20.492729 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:20.616890 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:20.739294 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:24:20.961608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:21.291313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18756): Launched 00:24:21.588647 run iperf3-srv_10.42.42.10(pid=18757): Launched 00:24:21.724151 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:24:21.943752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:22.273371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18758): Launched 00:24:22.569930 run iperf3-srv_10.42.42.10(pid=18759): Launched 00:24:22.705146 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:24:22.924696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:23.263763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18760): Launched 00:24:23.564610 run iperf3-srv_10.42.42.10(pid=18761): Launched 00:24:23.696350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:24:23.915610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:24.246579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18762): Launched 00:24:24.553689 run iperf3-srv_10.42.42.10(pid=18763): Launched 00:24:24.682337 tst iperf3m4.py:8: start network... 00:24:24.901765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:25.411648 run create_hlr_db(pid=18764): Launched 00:24:25.569737 bus /gobi_6: Setting Powered False 00:24:26.632894 run create_hlr_db(pid=18764): Terminated: ok {rc=0} 00:24:27.075562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18767): Launched 00:24:27.393975 run osmo-hlr_10.42.42.2(pid=18768): Launched 00:24:27.516289 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:28.063821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18770): Launched 00:24:28.382875 run osmo-stp_10.42.42.5(pid=18771): Launched 00:24:28.505521 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:29.055513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18773): Launched 00:24:29.178295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:29.447956 run patchelf(pid=18774): Launched 00:24:29.625454 run osmo-stp_10.42.42.5(pid=18771): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18771)] 00:24:29.760281 run osmo-stp_10.42.42.5(pid=18771): stdout: | (launched: 2022-12-14_00:24:28.324784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:29.896754 run osmo-stp_10.42.42.5(pid=18771): stderr: | [0;m[38;5;43m20221214002428515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002428515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002428516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002428516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002428516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002428517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002428517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:30.033268 run osmo-stp_10.42.42.5(pid=18771): stdout: | (launched: 2022-12-14_00:24:28.324784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:30.163641 run osmo-stp_10.42.42.5(pid=18771): stderr: | [0;m[38;5;43m20221214002428515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002428515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002428516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002428516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002428516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002428517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002428517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:30.318595 run patchelf(pid=18774): Terminating (SIGINT) 00:24:30.497999 run patchelf(pid=18774): Terminated: ok {rc=0} 00:24:30.626574 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18771): Process ended prematurely: osmo-stp_10.42.42.5(pid=18771) [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18771)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 00:24:30.636639 tst iperf3m4.py:8: Test FAILED (11.1 sec) 00:24:30.665330 run osmo-hlr_10.42.42.2(pid=18768): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18768)] 00:24:30.716049 run osmo-hlr_10.42.42.2(pid=18768): stdout: | (launched: 2022-12-14_00:24:27.336211) 00:24:30.768223 run osmo-hlr_10.42.42.2(pid=18768): stderr: | [0;m[1;31m20221214002427535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002427535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002427535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002427536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002427536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002427536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002427549 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002427557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002427558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002427558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:30.820325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18756): Terminating (SIGTERM) 00:24:30.863613 run iperf3-srv_10.42.42.10(pid=18757): Terminating (SIGTERM) 00:24:30.909264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18758): Terminating (SIGTERM) 00:24:30.953540 run iperf3-srv_10.42.42.10(pid=18759): Terminating (SIGTERM) 00:24:31.000045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18760): Terminating (SIGTERM) 00:24:31.044891 run iperf3-srv_10.42.42.10(pid=18761): Terminating (SIGTERM) 00:24:31.092013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18762): Terminating (SIGTERM) 00:24:31.136775 run iperf3-srv_10.42.42.10(pid=18763): Terminating (SIGTERM) 00:24:31.183655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18767): Terminating (SIGTERM) 00:24:31.227920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18770): Terminating (SIGTERM) 00:24:31.271826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18773): Terminating (SIGTERM) 00:24:31.316176 --- ParallelTerminationStrategy: PID 18756 died... 00:24:31.337920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18756): Terminated: ok {rc=0} 00:24:31.386349 --- ParallelTerminationStrategy: PID 18757 died... 00:24:31.407785 run iperf3-srv_10.42.42.10(pid=18757): Terminated {rc=256} 00:24:31.456233 --- ParallelTerminationStrategy: PID 18758 died... 00:24:31.478045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18758): Terminated: ok {rc=0} 00:24:31.526195 --- ParallelTerminationStrategy: PID 18759 died... 00:24:31.547903 run iperf3-srv_10.42.42.10(pid=18759): Terminated {rc=256} 00:24:31.596075 --- ParallelTerminationStrategy: PID 18760 died... 00:24:31.617578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18760): Terminated: ok {rc=0} 00:24:31.666006 --- ParallelTerminationStrategy: PID 18761 died... 00:24:31.687375 run iperf3-srv_10.42.42.10(pid=18761): Terminated {rc=256} 00:24:31.735534 --- ParallelTerminationStrategy: PID 18762 died... 00:24:31.757165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18762): Terminated: ok {rc=0} 00:24:31.805503 --- ParallelTerminationStrategy: PID 18763 died... 00:24:31.826802 run iperf3-srv_10.42.42.10(pid=18763): Terminated {rc=256} 00:24:31.875034 --- ParallelTerminationStrategy: PID 18767 died... 00:24:31.896907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18767): Terminated: ok {rc=0} 00:24:31.945208 --- ParallelTerminationStrategy: PID 18770 died... 00:24:31.966689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18770): Terminated: ok {rc=0} 00:24:32.015216 --- ParallelTerminationStrategy: PID 18773 died... 00:24:32.036579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18773): Terminated: ok {rc=0} 00:24:32.127426 bus /gobi_4: Setting Powered False 00:24:33.229019 bus /gobi_4: Setting Powered False 00:24:34.344587 bus /gobi_1: Setting Powered False 00:24:35.442662 bus /gobi_1: Setting Powered False 00:24:36.557852 bus /gobi_0: Setting Powered False 00:24:37.655919 bus /gobi_0: Setting Powered False 00:24:38.776574 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 00:24:39.878096 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:39.890524 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:24:39.940638 tst ping.py: using LAC 37268 00:24:40.062059 tst ping.py: using RAC 38 00:24:40.182932 tst ping.py: using CellId 37268 00:24:40.303599 tst ping.py: using BVCI 37269 00:24:40.416547 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:40.428906 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:40.440661 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:40.452450 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:40.464570 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:40.477059 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:40.489212 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:40.501379 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:40.617784 tst ping.py:19: start network... 00:24:40.814393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:41.268722 run create_hlr_db(pid=18775): Launched 00:24:41.389340 bus /gobi_6: Setting Powered False 00:24:42.448155 run create_hlr_db(pid=18775): Terminated: ok {rc=0} 00:24:42.878205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18777): Launched 00:24:43.191393 run osmo-hlr_10.42.42.2(pid=18778): Launched 00:24:43.310940 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:43.852599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18780): Launched 00:24:44.165316 run osmo-stp_10.42.42.5(pid=18781): Launched 00:24:44.284892 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:44.825699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18783): Launched 00:24:44.945564 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:45.210711 run patchelf(pid=18784): Launched 00:24:45.383969 run osmo-stp_10.42.42.5(pid=18781): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18781)] 00:24:45.517693 run osmo-stp_10.42.42.5(pid=18781): stdout: | (launched: 2022-12-14_00:24:44.108529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:45.652467 run osmo-stp_10.42.42.5(pid=18781): stderr: | [0;m[38;5;43m20221214002444298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002444298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002444298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002444299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002444299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002444299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002444299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:45.787273 run osmo-stp_10.42.42.5(pid=18781): stdout: | (launched: 2022-12-14_00:24:44.108529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:45.924353 run osmo-stp_10.42.42.5(pid=18781): stderr: | [0;m[38;5;43m20221214002444298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002444298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002444298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002444299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002444299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002444299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002444299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:46.081061 run patchelf(pid=18784): Terminating (SIGINT) 00:24:46.261085 run patchelf(pid=18784): Terminated: ok {rc=0} 00:24:46.391124 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18781): Process ended prematurely: osmo-stp_10.42.42.5(pid=18781) [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18781)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 00:24:46.401800 tst ping.py:22: Test FAILED (6.5 sec) 00:24:46.431176 run osmo-hlr_10.42.42.2(pid=18778): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18778)] 00:24:46.485930 run osmo-hlr_10.42.42.2(pid=18778): stdout: | (launched: 2022-12-14_00:24:43.134538) 00:24:46.540090 run osmo-hlr_10.42.42.2(pid=18778): stderr: | [0;m[1;31m20221214002443330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002443330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002443330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002443330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002443330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002443330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002443343 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002443351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002443351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002443351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:46.595311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18777): Terminating (SIGTERM) 00:24:46.638876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18780): Terminating (SIGTERM) 00:24:46.684399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18783): Terminating (SIGTERM) 00:24:46.729734 --- ParallelTerminationStrategy: PID 18777 died... 00:24:46.751785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18777): Terminated: ok {rc=0} 00:24:46.802733 --- ParallelTerminationStrategy: PID 18780 died... 00:24:46.823330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18780): Terminated: ok {rc=0} 00:24:46.871919 --- ParallelTerminationStrategy: PID 18783 died... 00:24:46.893266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18783): Terminated: ok {rc=0} 00:24:46.989662 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 00:24:48.084780 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:48.096688 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:24:48.146072 tst ping_idle_ping.py: using LAC 37269 00:24:48.263829 tst ping_idle_ping.py: using RAC 39 00:24:48.379181 tst ping_idle_ping.py: using CellId 37269 00:24:48.496063 tst ping_idle_ping.py: using BVCI 37270 00:24:48.602117 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:48.613559 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:48.624659 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:48.635863 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:48.646979 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:48.658094 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:48.669380 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:48.681071 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:48.798018 tst ping_idle_ping.py:24: start network... 00:24:49.010546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:49.500107 run create_hlr_db(pid=18785): Launched 00:24:49.620556 bus /gobi_6: Setting Powered False 00:24:50.683468 run create_hlr_db(pid=18785): Terminated: ok {rc=0} 00:24:51.104587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18787): Launched 00:24:51.400312 run osmo-hlr_10.42.42.2(pid=18788): Launched 00:24:51.513718 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:52.019631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18790): Launched 00:24:52.312919 run osmo-stp_10.42.42.5(pid=18791): Launched 00:24:52.424161 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:52.931010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18793): Launched 00:24:53.043193 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:53.291963 run patchelf(pid=18794): Launched 00:24:53.454962 run osmo-stp_10.42.42.5(pid=18791): ERR: Terminated: ERROR {rc=1} [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18791)] 00:24:53.580104 run osmo-stp_10.42.42.5(pid=18791): stdout: | (launched: 2022-12-14_00:24:52.258219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:53.706110 run osmo-stp_10.42.42.5(pid=18791): stderr: | [0;m[38;5;43m20221214002452425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002452425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002452426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002452426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002452429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002452429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002452429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:53.831958 run osmo-stp_10.42.42.5(pid=18791): stdout: | (launched: 2022-12-14_00:24:52.258219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:53.952438 run osmo-stp_10.42.42.5(pid=18791): stderr: | [0;m[38;5;43m20221214002452425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002452425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002452426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002452426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002452429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002452429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002452429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:54.095544 run patchelf(pid=18794): Terminating (SIGINT) 00:24:54.260225 run patchelf(pid=18794): Terminated: ok {rc=0} 00:24:54.378961 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18791): Process ended prematurely: osmo-stp_10.42.42.5(pid=18791) [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18791)] [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 00:24:54.387870 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 00:24:54.414239 run osmo-hlr_10.42.42.2(pid=18788): ERR: Terminated: ERROR {rc=237} [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18788)] 00:24:54.461652 run osmo-hlr_10.42.42.2(pid=18788): stdout: | (launched: 2022-12-14_00:24:51.346223) 00:24:54.510860 run osmo-hlr_10.42.42.2(pid=18788): stderr: | [0;m[1;31m20221214002451522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002451522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002451522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002451522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002451522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002451522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002451538 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002451548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002451548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002451548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:54.560550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18787): Terminating (SIGTERM) 00:24:54.604309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18790): Terminating (SIGTERM) 00:24:54.647291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18793): Terminating (SIGTERM) 00:24:54.690276 --- ParallelTerminationStrategy: PID 18787 died... 00:24:54.711267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18787): Terminated: ok {rc=0} 00:24:54.758448 --- ParallelTerminationStrategy: PID 18790 died... 00:24:54.779029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18790): Terminated: ok {rc=0} 00:24:54.825870 --- ParallelTerminationStrategy: PID 18793 died... 00:24:54.846483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18793): Terminated: ok {rc=0} 00:24:54.935747 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 00:24:56.251469 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:24:56.259331 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:24:56.291277 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:24:56.326068 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:24:56.379112 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:24:56.411109 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:24:56.445395 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:24:57.006691 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2396 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:24:57.012037 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:57.023645 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:24:57.091288 tst switch_tch_pdch.py: using LAC 37270 00:24:57.206716 tst switch_tch_pdch.py: using RAC 40 00:24:57.322022 tst switch_tch_pdch.py: using CellId 37270 00:24:57.437846 tst switch_tch_pdch.py: using BVCI 37271 00:24:57.544621 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:57.556225 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:57.567570 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:57.578943 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:57.590750 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:57.602562 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:57.614523 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:57.626495 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:24:57.746056 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:24:57.862467 tst switch_tch_pdch.py:51: start network... 00:24:58.059063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:58.539926 run create_hlr_db(pid=18798): Launched 00:24:58.659113 bus /gobi_6: Setting Powered False 00:24:59.720801 run create_hlr_db(pid=18798): Terminated: ok {rc=0} 00:25:00.140835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18800): Launched 00:25:00.432397 run osmo-hlr_10.42.42.2(pid=18801): Launched 00:25:00.543198 run osmo-stp_10.42.42.5: Starting osmo-stp 00:25:01.101033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18803): Launched 00:25:01.422594 run osmo-stp_10.42.42.5(pid=18807): Launched 00:25:01.664407 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:25:02.301924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18809): Launched 00:25:02.417885 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:25:02.666897 run patchelf(pid=18810): Launched 00:25:02.829731 run osmo-stp_10.42.42.5(pid=18807): ERR: Terminated: ERROR {rc=1} [trial-2396↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18807)] 00:25:02.954083 run osmo-stp_10.42.42.5(pid=18807): stdout: | (launched: 2022-12-14_00:25:01.367402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:03.080175 run osmo-stp_10.42.42.5(pid=18807): stderr: | [0;m[38;5;43m20221214002501698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002501698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002501698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002501698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002501699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002501699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002501699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:03.206050 run osmo-stp_10.42.42.5(pid=18807): stdout: | (launched: 2022-12-14_00:25:01.367402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:03.326771 run osmo-stp_10.42.42.5(pid=18807): stderr: | [0;m[38;5;43m20221214002501698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002501698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002501698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002501698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002501699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002501699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002501699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:03.469761 run patchelf(pid=18810): Terminating (SIGINT) 00:25:03.634876 run patchelf(pid=18810): Terminated: ok {rc=0} 00:25:03.753533 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18807): Process ended prematurely: osmo-stp_10.42.42.5(pid=18807) [trial-2396↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18807)] [trial-2396↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:25:03.762325 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 00:25:03.788446 run osmo-hlr_10.42.42.2(pid=18801): ERR: Terminated: ERROR {rc=237} [trial-2396↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18801)] 00:25:03.836137 run osmo-hlr_10.42.42.2(pid=18801): stdout: | (launched: 2022-12-14_00:25:00.379102) 00:25:03.884922 run osmo-hlr_10.42.42.2(pid=18801): stderr: | [0;m[1;31m20221214002500554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002500554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002500554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002500554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002500554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002500554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002500566 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002500575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002500575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002500575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:03.934156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18800): Terminating (SIGTERM) 00:25:03.973776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18803): Terminating (SIGTERM) 00:25:04.013059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18809): Terminating (SIGTERM) 00:25:04.052518 --- ParallelTerminationStrategy: PID 18800 died... 00:25:04.071372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18800): Terminated: ok {rc=0} 00:25:04.114777 --- ParallelTerminationStrategy: PID 18803 died... 00:25:04.132906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18803): Terminated: ok {rc=0} 00:25:04.176183 --- ParallelTerminationStrategy: PID 18809 died... 00:25:04.194455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18809): Terminated: ok {rc=0} 00:25:04.277422 bus /gobi_0: Setting Powered False 00:25:05.375035 bus /gobi_0: Setting Powered False 00:25:06.491618 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2396 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 nitb_smpp --------------------------------------------------------------------- 00:25:07.743989 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:25:07.746492 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 00:25:07.766686 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 00:25:07.773458 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 00:25:07.807561 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 00:25:07.829729 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 00:25:07.836798 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 00:25:08.356330 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2396 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 00:25:08.361930 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 00:25:08.380549 tst esme_connect_policy_acceptall.py: using MSISDN 8403 00:25:08.520751 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:25:09.116914 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18816): Launched 00:25:09.437229 run osmo-nitb_10.42.42.2(pid=18817): Launched 00:25:09.614750 run osmo-nitb_10.42.42.2(pid=18817): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18817)] 00:25:09.758334 run osmo-nitb_10.42.42.2(pid=18817): stdout: | (launched: 2022-12-14_00:25:09.379121) 00:25:09.903044 run osmo-nitb_10.42.42.2(pid=18817): stderr: | (launched: 2022-12-14_00:25:09.426754) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:10.047558 run osmo-nitb_10.42.42.2(pid=18817): stdout: | (launched: 2022-12-14_00:25:09.379121) 00:25:10.186748 run osmo-nitb_10.42.42.2(pid=18817): stderr: | (launched: 2022-12-14_00:25:09.426754) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18817): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18817) [trial-2396↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18817)] 00:25:10.558500 tst osmo-nitb_10.42.42.2(pid=18817): stdout: | (launched: 2022-12-14_00:25:09.379121) 00:25:10.679328 tst osmo-nitb_10.42.42.2(pid=18817): stderr: | (launched: 2022-12-14_00:25:09.426754) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:10.822478 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=18817): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18817) [trial-2396↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18817)] [trial-2396↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 00:25:10.830818 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 00:25:10.837422 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18816): Terminating (SIGTERM) 00:25:11.046159 --- ParallelTerminationStrategy: PID 18816 died... 00:25:11.067025 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18816): Terminated: ok {rc=0} ---------------------------------------------- trial-2396 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 00:25:11.114888 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 00:25:11.136586 tst esme_connect_policy_closed.py: using MSISDN 8404 00:25:11.257619 tst esme_connect_policy_closed.py: using MSISDN 8405 00:25:11.365582 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:25:11.924585 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18818): Launched 00:25:12.226007 run osmo-nitb_10.42.42.2(pid=18819): Launched 00:25:12.387986 run osmo-nitb_10.42.42.2(pid=18819): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18819)] 00:25:12.512358 run osmo-nitb_10.42.42.2(pid=18819): stdout: | (launched: 2022-12-14_00:25:12.171366) 00:25:12.637929 run osmo-nitb_10.42.42.2(pid=18819): stderr: | (launched: 2022-12-14_00:25:12.216113) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:12.764118 run osmo-nitb_10.42.42.2(pid=18819): stdout: | (launched: 2022-12-14_00:25:12.171366) 00:25:12.883927 run osmo-nitb_10.42.42.2(pid=18819): stderr: | (launched: 2022-12-14_00:25:12.216113) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:13.027206 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=18819): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18819) [trial-2396↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18819)] [trial-2396↪nitb_smpp↪esme_connect_policy_closed.py:24] 00:25:13.035608 tst esme_connect_policy_closed.py:24: Test FAILED (1.9 sec) 00:25:13.042208 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18818): Terminating (SIGTERM) 00:25:13.250789 --- ParallelTerminationStrategy: PID 18818 died... 00:25:13.271535 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18818): Terminated: ok {rc=0} ---------------------------------------------- trial-2396 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 00:25:13.320108 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 00:25:13.331522 tst nitb_smpp: Using 1 x bts (candidates: 1) 00:25:13.366370 tst esme_ms_sms_storeforward.py: using LAC 37271 00:25:13.487740 tst esme_ms_sms_storeforward.py: using RAC 41 00:25:13.607817 tst esme_ms_sms_storeforward.py: using CellId 37271 00:25:13.728778 tst esme_ms_sms_storeforward.py: using BVCI 37272 00:25:13.838681 tst nitb_smpp: Using 1 x modem (candidates: 1) 00:25:13.970126 tst esme_ms_sms_storeforward.py: using MSISDN 8406 00:25:14.088919 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 00:25:14.307594 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:25:14.965487 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18820): Launched 00:25:15.289136 run osmo-nitb_10.42.42.2(pid=18821): Launched 00:25:15.464553 run osmo-nitb_10.42.42.2(pid=18821): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18821)] 00:25:15.599203 run osmo-nitb_10.42.42.2(pid=18821): stdout: | (launched: 2022-12-14_00:25:15.230524) 00:25:15.735455 run osmo-nitb_10.42.42.2(pid=18821): stderr: | (launched: 2022-12-14_00:25:15.278821) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:15.881095 run osmo-nitb_10.42.42.2(pid=18821): stdout: | (launched: 2022-12-14_00:25:15.230524) 00:25:16.011993 run osmo-nitb_10.42.42.2(pid=18821): stderr: | (launched: 2022-12-14_00:25:15.278821) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:16.185102 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=18821): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18821) [trial-2396↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18821)] [trial-2396↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 00:25:16.194487 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 00:25:16.202816 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18820): Terminating (SIGTERM) 00:25:16.417015 --- ParallelTerminationStrategy: PID 18820 died... 00:25:16.441468 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18820): Terminated: ok {rc=0} 00:25:16.556155 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 00:25:17.659439 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 00:25:17.671195 tst nitb_smpp: Using 1 x bts (candidates: 1) 00:25:17.706983 tst esme_ms_sms_transaction.py: using LAC 37272 00:25:17.834477 tst esme_ms_sms_transaction.py: using RAC 42 00:25:17.960559 tst esme_ms_sms_transaction.py: using CellId 37272 00:25:18.089904 tst esme_ms_sms_transaction.py: using BVCI 37273 00:25:18.208112 tst nitb_smpp: Using 1 x modem (candidates: 1) 00:25:18.339823 tst esme_ms_sms_transaction.py: using MSISDN 8407 00:25:18.456933 tst esme_ms_sms_transaction.py:18: start nitb and bts... 00:25:18.675586 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:25:19.329242 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18822): Launched 00:25:19.650757 run osmo-nitb_10.42.42.2(pid=18823): Launched 00:25:19.829051 run osmo-nitb_10.42.42.2(pid=18823): ERR: Terminated: ERROR {rc=2} [trial-2396↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18823)] 00:25:19.973316 run osmo-nitb_10.42.42.2(pid=18823): stdout: | (launched: 2022-12-14_00:25:19.592727) 00:25:20.118943 run osmo-nitb_10.42.42.2(pid=18823): stderr: | (launched: 2022-12-14_00:25:19.640597) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:20.264472 run osmo-nitb_10.42.42.2(pid=18823): stdout: | (launched: 2022-12-14_00:25:19.592727) 00:25:20.404539 run osmo-nitb_10.42.42.2(pid=18823): stderr: | (launched: 2022-12-14_00:25:19.640597) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fc88fcd2268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18823): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18823) [trial-2396↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18823)] 00:25:20.772639 tst osmo-nitb_10.42.42.2(pid=18823): stdout: | (launched: 2022-12-14_00:25:19.592727) 00:25:20.902543 tst osmo-nitb_10.42.42.2(pid=18823): stderr: | (launched: 2022-12-14_00:25:19.640597) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:21.055810 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=18823): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18823) [trial-2396↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18823)] [trial-2396↪nitb_smpp↪esme_ms_sms_transaction.py:21] 00:25:21.064836 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 00:25:21.071702 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18822): Terminating (SIGTERM) 00:25:21.282583 --- ParallelTerminationStrategy: PID 18822 died... 00:25:21.304307 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18822): Terminated: ok {rc=0} 00:25:21.393448 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 smpp --------------------------------------------------------------------- 00:25:22.561386 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:25:22.564667 tst smpp: Verifying 1 x bts (candidates: 11) 00:25:22.586364 tst smpp: Verifying 6 x ip_address (candidates: 9) 00:25:22.615480 tst smpp: Verifying 1 x modem (candidates: 12) 00:25:22.651607 tst smpp: Reserving 1 x bts (candidates: 11) 00:25:22.673159 tst smpp: Reserving 6 x ip_address (candidates: 9) 00:25:22.700512 tst smpp: Reserving 1 x modem (candidates: 12) 00:25:23.228303 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2396 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 00:25:23.233829 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:23.244705 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:23.255576 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:23.266433 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:23.287322 tst esme_connect_policy_acceptall.py: using MSISDN 8408 00:25:23.408119 run osmo-stp_10.42.42.4: Starting osmo-stp 00:25:23.958146 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18827): Launched 00:25:24.281220 run osmo-stp_10.42.42.4(pid=18828): Launched 00:25:24.404574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:24.905210 run create_hlr_db(pid=18829): Launched 00:25:25.027367 bus /sierra_2: Setting Powered False 00:25:26.090528 run create_hlr_db(pid=18829): Terminated: ok {rc=0} 00:25:26.521390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18831): Launched 00:25:26.822744 run osmo-hlr_10.42.42.2(pid=18832): Launched 00:25:26.937606 run osmo-msc_10.42.42.5: Starting osmo-msc 00:25:27.484061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18834): Launched 00:25:27.786773 run osmo-msc_10.42.42.5(pid=18835): Launched 00:25:27.961337 run osmo-hlr_10.42.42.2(pid=18832): ERR: Terminated: ERROR {rc=237} [trial-2396↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18832)] 00:25:28.111749 run osmo-hlr_10.42.42.2(pid=18832): stdout: | (launched: 2022-12-14_00:25:26.767657) 00:25:28.249989 run osmo-hlr_10.42.42.2(pid=18832): stderr: | [0;m[1;31m20221214002526942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002526942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002526942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002526942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002526942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002526942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002526954 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002526963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002526963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002526963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:28.387702 run osmo-hlr_10.42.42.2(pid=18832): stdout: | (launched: 2022-12-14_00:25:26.767657) 00:25:28.517868 run osmo-hlr_10.42.42.2(pid=18832): stderr: | [0;m[1;31m20221214002526942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002526942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002526942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002526942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002526942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002526942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002526954 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002526963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002526963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002526963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:28.671963 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=18832): Process ended prematurely: osmo-hlr_10.42.42.2(pid=18832) [trial-2396↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18832)] [trial-2396↪smpp↪esme_connect_policy_acceptall.py:23] 00:25:28.680870 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.4 sec) 00:25:28.708381 run osmo-msc_10.42.42.5(pid=18835): ERR: Terminated: ERROR {rc=9} [trial-2396↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=18835)] 00:25:28.759634 run osmo-msc_10.42.42.5(pid=18835): stdout: | (launched: 2022-12-14_00:25:27.730950) 00:25:28.812543 run osmo-msc_10.42.42.5(pid=18835): stderr: | [0;m[38;5;43m20221214002528095 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221214002528095 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221214002528095 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221214002528095 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221214002528095 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221214002528095 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221214002528095 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221214002528096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214002528096 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 00:25:28.865089 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18827): Terminating (SIGTERM) 00:25:28.907003 run osmo-stp_10.42.42.4(pid=18828): Terminating (SIGTERM) 00:25:28.949263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18831): Terminating (SIGTERM) 00:25:28.992593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18834): Terminating (SIGTERM) 00:25:29.036075 --- ParallelTerminationStrategy: PID 18827 died... 00:25:29.056666 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18827): Terminated: ok {rc=0} 00:25:29.104526 --- ParallelTerminationStrategy: PID 18828 died... 00:25:29.124601 run osmo-stp_10.42.42.4(pid=18828): Terminated: ok {rc=0} 00:25:29.171306 --- ParallelTerminationStrategy: PID 18831 died... 00:25:29.191408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18831): Terminated: ok {rc=0} 00:25:29.238016 --- ParallelTerminationStrategy: PID 18834 died... 00:25:29.258038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18834): Terminated: ok {rc=0} ---------------------------------------------- trial-2396 smpp esme_connect_policy_closed.py ---------------------------------------------- 00:25:29.309996 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:29.321481 tst smpp: Using 1 x bts (candidates: 1) 00:25:29.356664 tst esme_connect_policy_closed.py: using LAC 37273 00:25:29.484857 tst esme_connect_policy_closed.py: using RAC 43 00:25:29.612328 tst esme_connect_policy_closed.py: using CellId 37273 00:25:29.739662 tst esme_connect_policy_closed.py: using BVCI 37274 00:25:29.858364 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:29.869421 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:29.880338 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:29.903406 tst esme_connect_policy_closed.py: using MSISDN 8409 00:25:30.034391 tst esme_connect_policy_closed.py: using MSISDN 8410 00:25:30.151587 run osmo-stp_10.42.42.4: Starting osmo-stp 00:25:30.700793 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18838): Launched 00:25:31.041661 run osmo-stp_10.42.42.4(pid=18839): Launched 00:25:31.259573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:31.774613 run create_hlr_db(pid=18840): Launched 00:25:32.991252 run create_hlr_db(pid=18840): Terminated: ok {rc=0} 00:25:33.331103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18842): Launched 00:25:33.652921 run osmo-hlr_10.42.42.2(pid=18843): Launched 00:25:33.776383 run osmo-msc_10.42.42.5: Starting osmo-msc 00:25:34.364264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18845): Launched 00:25:34.687432 run osmo-msc_10.42.42.5(pid=18846): Launched 00:25:34.868308 run osmo-hlr_10.42.42.2(pid=18843): ERR: Terminated: ERROR {rc=237} [trial-2396↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18843)] 00:25:35.005197 run osmo-hlr_10.42.42.2(pid=18843): stdout: | (launched: 2022-12-14_00:25:33.594763) 00:25:35.143513 run osmo-hlr_10.42.42.2(pid=18843): stderr: | [0;m[1;31m20221214002533794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002533794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002533794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002533794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002533794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002533794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002533806 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002533814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002533814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002533814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:35.278747 run osmo-hlr_10.42.42.2(pid=18843): stdout: | (launched: 2022-12-14_00:25:33.594763) 00:25:35.407553 run osmo-hlr_10.42.42.2(pid=18843): stderr: | [0;m[1;31m20221214002533794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002533794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002533794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002533794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002533794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002533794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002533806 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002533814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002533814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002533814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:35.562042 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=18843): Process ended prematurely: osmo-hlr_10.42.42.2(pid=18843) [trial-2396↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18843)] [trial-2396↪smpp↪esme_connect_policy_closed.py:31] 00:25:35.571034 tst esme_connect_policy_closed.py:31: Test FAILED (6.3 sec) 00:25:35.598215 run osmo-msc_10.42.42.5(pid=18846): ERR: Terminated: ERROR {rc=9} [trial-2396↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=18846)] 00:25:35.649115 run osmo-msc_10.42.42.5(pid=18846): stdout: | (launched: 2022-12-14_00:25:34.628942) 00:25:35.700841 run osmo-msc_10.42.42.5(pid=18846): stderr: | [0;m[38;5;43m20221214002534992 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221214002534992 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221214002534992 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221214002534992 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221214002534992 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221214002534992 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221214002534992 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221214002534993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214002534993 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 00:25:35.752690 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18838): Terminating (SIGTERM) 00:25:35.794955 run osmo-stp_10.42.42.4(pid=18839): Terminating (SIGTERM) 00:25:35.837887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18842): Terminating (SIGTERM) 00:25:35.882215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18845): Terminating (SIGTERM) 00:25:35.927937 --- ParallelTerminationStrategy: PID 18838 died... 00:25:35.949740 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18838): Terminated: ok {rc=0} 00:25:35.998634 --- ParallelTerminationStrategy: PID 18839 died... 00:25:36.018741 run osmo-stp_10.42.42.4(pid=18839): Terminated: ok {rc=0} 00:25:36.065380 --- ParallelTerminationStrategy: PID 18842 died... 00:25:36.085343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18842): Terminated: ok {rc=0} 00:25:36.131641 --- ParallelTerminationStrategy: PID 18845 died... 00:25:36.151762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18845): Terminated: ok {rc=0} ---------------------------------------------- trial-2396 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 00:25:36.203576 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:36.215451 tst smpp: Using 1 x bts (candidates: 1) 00:25:36.251470 tst esme_ms_sms_storeforward.py: using LAC 37274 00:25:36.374802 tst esme_ms_sms_storeforward.py: using RAC 44 00:25:36.494843 tst esme_ms_sms_storeforward.py: using CellId 37274 00:25:36.616597 tst esme_ms_sms_storeforward.py: using BVCI 37275 00:25:36.728149 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:36.738656 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:36.748856 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:36.759085 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:36.769292 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:36.779432 tst smpp: Using 1 x modem (candidates: 1) 00:25:36.911250 tst esme_ms_sms_storeforward.py: using MSISDN 8411 00:25:37.029986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:37.531422 run create_hlr_db(pid=18849): Launched 00:25:38.712574 run create_hlr_db(pid=18849): Terminated: ok {rc=0} 00:25:39.052376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18851): Launched 00:25:39.374769 run osmo-hlr_10.42.42.2(pid=18852): Launched 00:25:39.498885 run osmo-stp_10.42.42.5: Starting osmo-stp 00:25:40.056200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18854): Launched 00:25:40.379980 run osmo-stp_10.42.42.5(pid=18855): Launched 00:25:40.504483 run osmo-msc_10.42.42.6: Starting osmo-msc 00:25:41.087084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18857): Launched 00:25:41.409401 run osmo-msc_10.42.42.6(pid=18858): Launched 00:25:41.590940 run osmo-stp_10.42.42.5(pid=18855): ERR: Terminated: ERROR {rc=1} [trial-2396↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18855)] 00:25:41.727770 run osmo-stp_10.42.42.5(pid=18855): stdout: | (launched: 2022-12-14_00:25:40.321412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:41.865539 run osmo-stp_10.42.42.5(pid=18855): stderr: | [0;m[38;5;43m20221214002540515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002540515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002540515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002540516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002540516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002540516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002540516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:42.002143 run osmo-stp_10.42.42.5(pid=18855): stdout: | (launched: 2022-12-14_00:25:40.321412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:42.131239 run osmo-stp_10.42.42.5(pid=18855): stderr: | [0;m[38;5;43m20221214002540515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002540515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002540515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002540516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002540516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002540516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002540516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:42.285120 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=18855): Process ended prematurely: osmo-stp_10.42.42.5(pid=18855) [trial-2396↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18855)] [trial-2396↪smpp↪esme_ms_sms_storeforward.py:30] 00:25:42.294071 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.1 sec) 00:25:42.321253 run osmo-hlr_10.42.42.2(pid=18852): ERR: Terminated: ERROR {rc=237} [trial-2396↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18852)] 00:25:42.371881 run osmo-hlr_10.42.42.2(pid=18852): stdout: | (launched: 2022-12-14_00:25:39.316352) 00:25:42.424158 run osmo-hlr_10.42.42.2(pid=18852): stderr: | [0;m[1;31m20221214002539512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002539512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002539512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002539513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002539513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002539513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002539525 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002539533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002539533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002539533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:42.496759 run osmo-msc_10.42.42.6(pid=18858): ERR: Terminated: ERROR {rc=2} [trial-2396↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18858)] 00:25:42.546523 run osmo-msc_10.42.42.6(pid=18858): stdout: | (launched: 2022-12-14_00:25:41.350934) 00:25:42.597868 run osmo-msc_10.42.42.6(pid=18858): stderr: | [0;m[38;5;43m20221214002541671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002541671 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb00387bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002541671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002541671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002541671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002541672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002541676 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002541677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002541677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002541677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:25:42.650023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18851): Terminating (SIGTERM) 00:25:42.691680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18854): Terminating (SIGTERM) 00:25:42.733530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18857): Terminating (SIGTERM) 00:25:42.775447 --- ParallelTerminationStrategy: PID 18851 died... 00:25:42.795577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18851): Terminated: ok {rc=0} 00:25:42.842309 --- ParallelTerminationStrategy: PID 18854 died... 00:25:42.862366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18854): Terminated: ok {rc=0} 00:25:42.908837 --- ParallelTerminationStrategy: PID 18857 died... 00:25:42.929387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18857): Terminated: ok {rc=0} 00:25:43.018436 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 smpp esme_ms_sms_transaction.py ---------------------------------------------- 00:25:44.106003 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:44.117748 tst smpp: Using 1 x bts (candidates: 1) 00:25:44.153272 tst esme_ms_sms_transaction.py: using LAC 37275 00:25:44.280665 tst esme_ms_sms_transaction.py: using RAC 45 00:25:44.406748 tst esme_ms_sms_transaction.py: using CellId 37275 00:25:44.538373 tst esme_ms_sms_transaction.py: using BVCI 37276 00:25:44.656550 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:44.667639 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:44.678344 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:44.689153 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:44.700320 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:44.711491 tst smpp: Using 1 x modem (candidates: 1) 00:25:44.841191 tst esme_ms_sms_transaction.py: using MSISDN 8412 00:25:44.960429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:45.462786 run create_hlr_db(pid=18860): Launched 00:25:45.586525 bus /sierra_2: Setting Powered False 00:25:46.662500 run create_hlr_db(pid=18860): Terminated: ok {rc=0} 00:25:47.158504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18862): Launched 00:25:47.471864 run osmo-hlr_10.42.42.2(pid=18863): Launched 00:25:47.589990 run osmo-stp_10.42.42.5: Starting osmo-stp 00:25:48.111376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18865): Launched 00:25:48.412250 run osmo-stp_10.42.42.5(pid=18866): Launched 00:25:48.526891 run osmo-msc_10.42.42.6: Starting osmo-msc 00:25:49.071045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18868): Launched 00:25:49.372580 run osmo-msc_10.42.42.6(pid=18869): Launched 00:25:49.541666 run osmo-stp_10.42.42.5(pid=18866): ERR: Terminated: ERROR {rc=1} [trial-2396↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18866)] 00:25:49.670179 run osmo-stp_10.42.42.5(pid=18866): stdout: | (launched: 2022-12-14_00:25:48.357272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:49.798428 run osmo-stp_10.42.42.5(pid=18866): stderr: | [0;m[38;5;43m20221214002548529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002548529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002548529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002548530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002548530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002548530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002548530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:49.923865 run osmo-stp_10.42.42.5(pid=18866): stdout: | (launched: 2022-12-14_00:25:48.357272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:50.044409 run osmo-stp_10.42.42.5(pid=18866): stderr: | [0;m[38;5;43m20221214002548529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002548529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002548529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002548530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002548530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002548530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002548530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:50.187691 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=18866): Process ended prematurely: osmo-stp_10.42.42.5(pid=18866) [trial-2396↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18866)] [trial-2396↪smpp↪esme_ms_sms_transaction.py:28] 00:25:50.195858 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec) 00:25:50.221491 run osmo-hlr_10.42.42.2(pid=18863): ERR: Terminated: ERROR {rc=237} [trial-2396↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18863)] 00:25:50.269752 run osmo-hlr_10.42.42.2(pid=18863): stdout: | (launched: 2022-12-14_00:25:47.416600) 00:25:50.319497 run osmo-hlr_10.42.42.2(pid=18863): stderr: | [0;m[1;31m20221214002547594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002547594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002547594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002547594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002547594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002547594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002547606 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002547615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002547616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002547616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:50.388638 run osmo-msc_10.42.42.6(pid=18869): ERR: Terminated: ERROR {rc=2} [trial-2396↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18869)] 00:25:50.436526 run osmo-msc_10.42.42.6(pid=18869): stdout: | (launched: 2022-12-14_00:25:49.317643) 00:25:50.486029 run osmo-msc_10.42.42.6(pid=18869): stderr: | [0;m[38;5;43m20221214002549590 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002549590 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa600476c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002549590 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002549591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002549591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002549591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002549594 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002549595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002549595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002549595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:25:50.535763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18862): Terminating (SIGTERM) 00:25:50.575344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18865): Terminating (SIGTERM) 00:25:50.614902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18868): Terminating (SIGTERM) 00:25:50.654913 --- ParallelTerminationStrategy: PID 18862 died... 00:25:50.674121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18862): Terminated: ok {rc=0} 00:25:50.717722 --- ParallelTerminationStrategy: PID 18865 died... 00:25:50.735932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18865): Terminated: ok {rc=0} 00:25:50.779344 --- ParallelTerminationStrategy: PID 18868 died... 00:25:50.797718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18868): Terminated: ok {rc=0} 00:25:50.879771 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 encryption --------------------------------------------------------------------- 00:25:52.074626 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:25:52.077764 tst encryption: Verifying 1 x bts (candidates: 11) 00:25:52.098204 tst encryption: Verifying 6 x ip_address (candidates: 9) 00:25:52.124689 tst encryption: Verifying 1 x modem (candidates: 12) 00:25:52.159829 tst encryption: Reserving 1 x bts (candidates: 11) 00:25:52.180361 tst encryption: Reserving 6 x ip_address (candidates: 9) 00:25:52.206688 tst encryption: Reserving 1 x modem (candidates: 12) 00:25:52.735225 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2396 encryption register_a5_0_authopt.py ---------------------------------------------- 00:25:52.786887 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:52.797366 tst encryption: Using 1 x bts (candidates: 1) 00:25:52.832213 tst register_a5_0_authopt.py: using LAC 37276 00:25:52.962634 tst register_a5_0_authopt.py: using RAC 46 00:25:53.092123 tst register_a5_0_authopt.py: using CellId 37276 00:25:53.219838 tst register_a5_0_authopt.py: using BVCI 37277 00:25:53.338719 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:53.349684 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:53.360526 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:53.371239 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:53.382256 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:53.393219 tst encryption: Using 1 x modem (candidates: 1) 00:25:53.513786 tst register_a5_0_authopt.py:8: start network... 00:25:53.734852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:54.239621 run create_hlr_db(pid=18877): Launched 00:25:54.364178 bus /sierra_2: Setting Powered False 00:25:55.429350 run create_hlr_db(pid=18877): Terminated: ok {rc=0} 00:25:55.867479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18879): Launched 00:25:56.174266 run osmo-hlr_10.42.42.2(pid=18880): Launched 00:25:56.290700 run osmo-stp_10.42.42.5: Starting osmo-stp 00:25:56.816686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18882): Launched 00:25:57.121888 run osmo-stp_10.42.42.5(pid=18883): Launched 00:25:57.238555 run osmo-msc_10.42.42.6: Starting osmo-msc 00:25:57.789386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18885): Launched 00:25:58.094926 run osmo-msc_10.42.42.6(pid=18886): Launched 00:25:58.266413 run osmo-stp_10.42.42.5(pid=18883): ERR: Terminated: ERROR {rc=1} [trial-2396↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18883)] 00:25:58.395770 run osmo-stp_10.42.42.5(pid=18883): stdout: | (launched: 2022-12-14_00:25:57.066162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:58.525444 run osmo-stp_10.42.42.5(pid=18883): stderr: | [0;m[38;5;43m20221214002557236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002557236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002557237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002557237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002557237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002557238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002557238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:58.652521 run osmo-stp_10.42.42.5(pid=18883): stdout: | (launched: 2022-12-14_00:25:57.066162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:58.774103 run osmo-stp_10.42.42.5(pid=18883): stderr: | [0;m[38;5;43m20221214002557236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002557236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002557237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002557237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002557237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002557238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002557238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:58.919564 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18883): Process ended prematurely: osmo-stp_10.42.42.5(pid=18883) [trial-2396↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18883)] [trial-2396↪encryption↪register_a5_0_authopt.py:8] 00:25:58.928417 tst register_a5_0_authopt.py:8: Test FAILED (6.2 sec) 00:25:58.954727 run osmo-hlr_10.42.42.2(pid=18880): ERR: Terminated: ERROR {rc=237} [trial-2396↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18880)] 00:25:59.002330 run osmo-hlr_10.42.42.2(pid=18880): stdout: | (launched: 2022-12-14_00:25:56.118692) 00:25:59.051696 run osmo-hlr_10.42.42.2(pid=18880): stderr: | [0;m[1;31m20221214002556297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002556297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002556297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002556297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002556297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002556297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002556309 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002556318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002556318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002556318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:59.121042 run osmo-msc_10.42.42.6(pid=18886): ERR: Terminated: ERROR {rc=2} [trial-2396↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18886)] 00:25:59.168586 run osmo-msc_10.42.42.6(pid=18886): stdout: | (launched: 2022-12-14_00:25:58.039399) 00:25:59.218270 run osmo-msc_10.42.42.6(pid=18886): stderr: | [0;m[38;5;43m20221214002558312 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002558312 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdb6fda7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002558312 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002558312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002558313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002558313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002558314 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002558315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002558315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002558315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:25:59.268048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18879): Terminating (SIGTERM) 00:25:59.307373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18882): Terminating (SIGTERM) 00:25:59.346889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18885): Terminating (SIGTERM) 00:25:59.387008 --- ParallelTerminationStrategy: PID 18879 died... 00:25:59.406363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18879): Terminated: ok {rc=0} 00:25:59.450483 --- ParallelTerminationStrategy: PID 18882 died... 00:25:59.469101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18882): Terminated: ok {rc=0} 00:25:59.512798 --- ParallelTerminationStrategy: PID 18885 died... 00:25:59.532123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18885): Terminated: ok {rc=0} 00:25:59.615291 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 encryption register_a5_0_authreq.py ---------------------------------------------- 00:26:00.760377 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:00.771643 tst encryption: Using 1 x bts (candidates: 1) 00:26:00.807613 tst register_a5_0_authreq.py: using LAC 37277 00:26:00.959908 tst register_a5_0_authreq.py: using RAC 47 00:26:01.095651 tst register_a5_0_authreq.py: using CellId 37277 00:26:01.228897 tst register_a5_0_authreq.py: using BVCI 37278 00:26:01.389670 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:01.401402 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:01.412880 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:01.424328 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:01.436801 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:01.449421 tst encryption: Using 1 x modem (candidates: 1) 00:26:01.574709 tst register_a5_0_authreq.py:8: start network... 00:26:01.788803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:26:02.277500 run create_hlr_db(pid=18888): Launched 00:26:02.403672 bus /sierra_2: Setting Powered False 00:26:03.465690 run create_hlr_db(pid=18888): Terminated: ok {rc=0} 00:26:03.910590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18890): Launched 00:26:04.237858 run osmo-hlr_10.42.42.2(pid=18891): Launched 00:26:04.363517 run osmo-stp_10.42.42.5: Starting osmo-stp 00:26:04.924113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18893): Launched 00:26:05.249142 run osmo-stp_10.42.42.5(pid=18894): Launched 00:26:05.373708 run osmo-msc_10.42.42.6: Starting osmo-msc 00:26:05.962126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18896): Launched 00:26:06.288686 run osmo-msc_10.42.42.6(pid=18897): Launched 00:26:06.470729 run osmo-stp_10.42.42.5(pid=18894): ERR: Terminated: ERROR {rc=1} [trial-2396↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18894)] 00:26:06.608937 run osmo-stp_10.42.42.5(pid=18894): stdout: | (launched: 2022-12-14_00:26:05.190083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:06.747157 run osmo-stp_10.42.42.5(pid=18894): stderr: | [0;m[38;5;43m20221214002605382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002605383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002605383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002605383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002605386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002605386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002605386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:06.884132 run osmo-stp_10.42.42.5(pid=18894): stdout: | (launched: 2022-12-14_00:26:05.190083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:07.014496 run osmo-stp_10.42.42.5(pid=18894): stderr: | [0;m[38;5;43m20221214002605382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002605383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002605383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002605383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002605386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002605386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002605386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:07.169838 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18894): Process ended prematurely: osmo-stp_10.42.42.5(pid=18894) [trial-2396↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18894)] [trial-2396↪encryption↪register_a5_0_authreq.py:8] 00:26:07.179285 tst register_a5_0_authreq.py:8: Test FAILED (6.5 sec) 00:26:07.206620 run osmo-hlr_10.42.42.2(pid=18891): ERR: Terminated: ERROR {rc=237} [trial-2396↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18891)] 00:26:07.257087 run osmo-hlr_10.42.42.2(pid=18891): stdout: | (launched: 2022-12-14_00:26:04.178835) 00:26:07.308581 run osmo-hlr_10.42.42.2(pid=18891): stderr: | [0;m[1;31m20221214002604377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002604377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002604377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002604377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002604377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002604377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002604410 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002604420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002604420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002604421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:26:07.380711 run osmo-msc_10.42.42.6(pid=18897): ERR: Terminated: ERROR {rc=2} [trial-2396↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18897)] 00:26:07.430239 run osmo-msc_10.42.42.6(pid=18897): stdout: | (launched: 2022-12-14_00:26:06.229281) 00:26:07.482127 run osmo-msc_10.42.42.6(pid=18897): stderr: | [0;m[38;5;43m20221214002606552 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002606553 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff934975c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002606553 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002606553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002606553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002606553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002606555 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002606555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002606555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002606555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:26:07.534141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18890): Terminating (SIGTERM) 00:26:07.575779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18893): Terminating (SIGTERM) 00:26:07.618158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18896): Terminating (SIGTERM) 00:26:07.660573 --- ParallelTerminationStrategy: PID 18890 died... 00:26:07.681103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18890): Terminated: ok {rc=0} 00:26:07.727586 --- ParallelTerminationStrategy: PID 18893 died... 00:26:07.747560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18893): Terminated: ok {rc=0} 00:26:07.793991 --- ParallelTerminationStrategy: PID 18896 died... 00:26:07.813959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18896): Terminated: ok {rc=0} 00:26:07.901710 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 encryption register_a5_1_authreq.py ---------------------------------------------- 00:26:09.054407 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:09.066143 tst encryption: Using 1 x bts (candidates: 1) 00:26:09.103496 tst register_a5_1_authreq.py: using LAC 37278 00:26:09.233358 tst register_a5_1_authreq.py: using RAC 48 00:26:09.361433 tst register_a5_1_authreq.py: using CellId 37278 00:26:09.491227 tst register_a5_1_authreq.py: using BVCI 37279 00:26:09.611405 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:09.622377 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:09.633236 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:09.643949 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:09.655074 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:09.666247 tst encryption: Using 1 x modem (candidates: 1) 00:26:09.782554 tst register_a5_1_authreq.py:8: start network... 00:26:09.989497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:26:10.462865 run create_hlr_db(pid=18899): Launched 00:26:10.588411 bus /sierra_2: Setting Powered False 00:26:11.649194 run create_hlr_db(pid=18899): Terminated: ok {rc=0} 00:26:12.074487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18901): Launched 00:26:12.379601 run osmo-hlr_10.42.42.2(pid=18902): Launched 00:26:12.497200 run osmo-stp_10.42.42.5: Starting osmo-stp 00:26:13.022485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18904): Launched 00:26:13.327873 run osmo-stp_10.42.42.5(pid=18905): Launched 00:26:13.444683 run osmo-msc_10.42.42.6: Starting osmo-msc 00:26:13.993995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18907): Launched 00:26:14.298739 run osmo-msc_10.42.42.6(pid=18908): Launched 00:26:14.469634 run osmo-stp_10.42.42.5(pid=18905): ERR: Terminated: ERROR {rc=1} [trial-2396↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18905)] 00:26:14.598401 run osmo-stp_10.42.42.5(pid=18905): stdout: | (launched: 2022-12-14_00:26:13.272112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:14.727121 run osmo-stp_10.42.42.5(pid=18905): stderr: | [0;m[38;5;43m20221214002613444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002613444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002613444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002613445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002613445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002613445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002613445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:14.853660 run osmo-stp_10.42.42.5(pid=18905): stdout: | (launched: 2022-12-14_00:26:13.272112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:14.974968 run osmo-stp_10.42.42.5(pid=18905): stderr: | [0;m[38;5;43m20221214002613444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002613444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002613444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002613445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002613445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002613445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002613445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:15.120020 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18905): Process ended prematurely: osmo-stp_10.42.42.5(pid=18905) [trial-2396↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18905)] [trial-2396↪encryption↪register_a5_1_authreq.py:8] 00:26:15.128864 tst register_a5_1_authreq.py:8: Test FAILED (6.1 sec) 00:26:15.154958 run osmo-hlr_10.42.42.2(pid=18902): ERR: Terminated: ERROR {rc=237} [trial-2396↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18902)] 00:26:15.202355 run osmo-hlr_10.42.42.2(pid=18902): stdout: | (launched: 2022-12-14_00:26:12.323912) 00:26:15.251324 run osmo-hlr_10.42.42.2(pid=18902): stderr: | [0;m[1;31m20221214002612502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002612502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002612502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002612502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002612502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002612502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002612514 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002612523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002612523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002612523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:26:15.320252 run osmo-msc_10.42.42.6(pid=18908): ERR: Terminated: ERROR {rc=2} [trial-2396↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18908)] 00:26:15.367440 run osmo-msc_10.42.42.6(pid=18908): stdout: | (launched: 2022-12-14_00:26:14.242985) 00:26:15.416173 run osmo-msc_10.42.42.6(pid=18908): stderr: | [0;m[38;5;43m20221214002614513 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002614514 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f274e005c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002614514 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002614514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002614514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002614514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002614516 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002614516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002614517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002614517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:26:15.465260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18901): Terminating (SIGTERM) 00:26:15.504541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18904): Terminating (SIGTERM) 00:26:15.544217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18907): Terminating (SIGTERM) 00:26:15.584163 --- ParallelTerminationStrategy: PID 18901 died... 00:26:15.603713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18901): Terminated: ok {rc=0} 00:26:15.647619 --- ParallelTerminationStrategy: PID 18904 died... 00:26:15.666271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18904): Terminated: ok {rc=0} 00:26:15.710002 --- ParallelTerminationStrategy: PID 18907 died... 00:26:15.728429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18907): Terminated: ok {rc=0} 00:26:15.814569 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2396 encryption register_a5_3_authreq.py ---------------------------------------------- 00:26:16.979117 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:16.991608 tst encryption: Using 1 x bts (candidates: 1) 00:26:17.029089 tst register_a5_3_authreq.py: using LAC 37279 00:26:17.161204 tst register_a5_3_authreq.py: using RAC 49 00:26:17.293082 tst register_a5_3_authreq.py: using CellId 37279 00:26:17.422902 tst register_a5_3_authreq.py: using BVCI 37280 00:26:17.544160 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:17.555325 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:17.566461 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:17.577439 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:17.588680 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:17.600070 tst encryption: Using 1 x modem (candidates: 1) 00:26:17.730815 tst register_a5_3_authreq.py:8: start network... 00:26:17.952235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:26:18.456855 run create_hlr_db(pid=18910): Launched 00:26:18.581412 bus /sierra_2: Setting Powered False 00:26:19.646481 run create_hlr_db(pid=18910): Terminated: ok {rc=0} 00:26:20.097957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18912): Launched 00:26:20.423727 run osmo-hlr_10.42.42.2(pid=18913): Launched 00:26:20.549605 run osmo-stp_10.42.42.5: Starting osmo-stp 00:26:21.077013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18915): Launched 00:26:21.381867 run osmo-stp_10.42.42.5(pid=18916): Launched 00:26:21.498160 run osmo-msc_10.42.42.6: Starting osmo-msc 00:26:22.048726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18918): Launched 00:26:22.354351 run osmo-msc_10.42.42.6(pid=18919): Launched 00:26:22.524439 run osmo-stp_10.42.42.5(pid=18916): ERR: Terminated: ERROR {rc=1} [trial-2396↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18916)] 00:26:22.654704 run osmo-stp_10.42.42.5(pid=18916): stdout: | (launched: 2022-12-14_00:26:21.326366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:22.784445 run osmo-stp_10.42.42.5(pid=18916): stderr: | [0;m[38;5;43m20221214002621497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002621498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002621498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002621498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002621499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002621499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002621499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:22.911495 run osmo-stp_10.42.42.5(pid=18916): stdout: | (launched: 2022-12-14_00:26:21.326366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:23.032849 run osmo-stp_10.42.42.5(pid=18916): stderr: | [0;m[38;5;43m20221214002621497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002621498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002621498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002621498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002621499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002621499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002621499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:23.178141 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18916): Process ended prematurely: osmo-stp_10.42.42.5(pid=18916) [trial-2396↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18916)] [trial-2396↪encryption↪register_a5_3_authreq.py:8] 00:26:23.186795 tst register_a5_3_authreq.py:8: Test FAILED (6.3 sec) 00:26:23.212627 run osmo-hlr_10.42.42.2(pid=18913): ERR: Terminated: ERROR {rc=237} [trial-2396↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18913)] 00:26:23.260747 run osmo-hlr_10.42.42.2(pid=18913): stdout: | (launched: 2022-12-14_00:26:20.364921) 00:26:23.309927 run osmo-hlr_10.42.42.2(pid=18913): stderr: | [0;m[1;31m20221214002620563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002620563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002620563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002620563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002620563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002620563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002620575 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002620583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002620583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002620583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:26:23.378478 run osmo-msc_10.42.42.6(pid=18919): ERR: Terminated: ERROR {rc=2} [trial-2396↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18919)] 00:26:23.425551 run osmo-msc_10.42.42.6(pid=18919): stdout: | (launched: 2022-12-14_00:26:22.299069) 00:26:23.474535 run osmo-msc_10.42.42.6(pid=18919): stderr: | [0;m[38;5;43m20221214002622571 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002622571 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f65d5383c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002622571 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002622572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002622572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002622572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002622574 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002622574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002622574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002622574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:26:23.523833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18912): Terminating (SIGTERM) 00:26:23.563084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18915): Terminating (SIGTERM) 00:26:23.602451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18918): Terminating (SIGTERM) 00:26:23.641815 --- ParallelTerminationStrategy: PID 18912 died... 00:26:23.660597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18912): Terminated: ok {rc=0} 00:26:23.704162 --- ParallelTerminationStrategy: PID 18915 died... 00:26:23.722488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18915): Terminated: ok {rc=0} 00:26:23.765839 --- ParallelTerminationStrategy: PID 18918 died... 00:26:23.784236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18918): Terminated: ok {rc=0} 00:26:23.869802 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 00:26:25.077246 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:26:25.081887 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 00:26:25.099815 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 00:26:25.126082 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 00:26:25.152471 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 00:26:25.170569 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 00:26:25.196610 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 00:26:25.709139 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2396 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 00:26:25.714858 tst handover.py:11: TEST_CONFIG: {} 00:26:25.934692 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:26:25.951143 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:26:25.974677 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:26:26.026872 tst handover.py: using MSISDN 8413 00:26:26.146994 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8413', subscriber_id=0} 00:26:26.261758 run srsepc_10.42.42.118: Starting srsepc 00:26:28.181918 run rm-remote-dir(pid=18924): Launched 00:26:28.311226 bus /sierra_2: Setting Powered False 00:26:29.380481 run rm-remote-dir(pid=18924): Terminated: ok {rc=0} 00:26:29.848404 run mk-remote-dir(pid=18925): Launched 00:26:31.037818 run mk-remote-dir(pid=18925): Terminated: ok {rc=0} 00:26:31.361356 run scp-inst-to-remote(pid=18926): Launched 00:26:33.575057 run scp-inst-to-remote(pid=18926): Terminated: ok {rc=0} 00:26:33.929423 run rm-remote-dir(pid=18928): Launched 00:26:35.114365 run rm-remote-dir(pid=18928): Terminated: ok {rc=0} 00:26:35.447626 run mk-remote-dir(pid=18929): Launched 00:26:36.625252 run mk-remote-dir(pid=18929): Terminated: ok {rc=0} 00:26:36.909151 run scp-cfg-to-remote(pid=18930): Launched 00:26:38.084456 run scp-cfg-to-remote(pid=18930): Terminated: ok {rc=0} 00:26:38.366301 run scp-db-to-remote(pid=18932): Launched 00:26:39.542440 run scp-db-to-remote(pid=18932): Terminated: ok {rc=0} 00:26:39.672817 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:26:39.978749 run patchelf(pid=18934): Launched 00:26:41.154431 run patchelf(pid=18934): Terminated: ok {rc=0} 00:26:41.284465 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:26:41.588922 run setcap-netadm(pid=18935): Launched 00:26:42.764431 run setcap-netadm(pid=18935): Terminated: ok {rc=0} 00:26:43.084175 run srsepc(pid=18936): Launched 00:26:43.198809 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:26:44.360786 run rm-remote-dir(pid=18937): Launched 00:26:44.547395 run srsepc(pid=18936): ERR: Terminated: ERROR {rc=127} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18936)] 00:26:44.689444 run srsepc(pid=18936): stdout: | (launched: 2022-12-14_00:26:43.028393) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:26:44.832414 run srsepc(pid=18936): stderr: | (launched: 2022-12-14_00:26:43.073750) | Connection to 10.42.42.116 closed. 00:26:44.975389 run srsepc(pid=18936): stdout: | (launched: 2022-12-14_00:26:43.028393) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:26:45.112670 run srsepc(pid=18936): stderr: | (launched: 2022-12-14_00:26:43.073750) | Connection to 10.42.42.116 closed. 00:26:45.274998 run rm-remote-dir(pid=18937): Terminating (SIGINT) 00:26:45.462645 run rm-remote-dir(pid=18937): Terminated: ok {rc=0} 00:26:45.599008 tst handover.py:37: ERR: Error: srsepc(pid=18936): Process ended prematurely: srsepc(pid=18936) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18936)] [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 00:26:45.609533 tst handover.py:37: Test FAILED (19.9 sec) 00:26:45.689758 run scp-back-log(pid=18938): Launched 00:26:46.766525 run scp-back-log(pid=18938): ERR: Terminated: ERROR {rc=1} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18938)] 00:26:46.834241 run scp-back-log(pid=18938): stdout: | (launched: 2022-12-14_00:26:45.658544) 00:26:46.903139 run scp-back-log(pid=18938): stderr: | (launched: 2022-12-14_00:26:45.679230) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:26:46.979329 tst srsepc_10.42.42.118: Error('scp-back-log(pid=18938): launch_sync(): local process exited with status 1 [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18938)]') ---------------------------------------------- trial-2396 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 00:26:47.028021 tst iperf3_bidir.py:13: Number of physical ue: 1 00:26:47.264901 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:26:47.309793 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 00:26:47.529094 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:26:47.545580 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:26:47.577050 tst iperf3_bidir.py: using MSISDN 8414 00:26:47.696635 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8414', subscriber_id=0} 00:26:47.811449 run srsepc_10.42.42.118: Starting srsepc 00:26:48.478426 run rm-remote-dir(pid=18940): Launched 00:26:49.668708 run rm-remote-dir(pid=18940): Terminated: ok {rc=0} 00:26:50.024325 run mk-remote-dir(pid=18941): Launched 00:26:51.212780 run mk-remote-dir(pid=18941): Terminated: ok {rc=0} 00:26:51.515814 run scp-inst-to-remote(pid=18942): Launched 00:26:53.704885 run scp-inst-to-remote(pid=18942): Terminated: ok {rc=0} 00:26:54.058219 run rm-remote-dir(pid=18944): Launched 00:26:55.246102 run rm-remote-dir(pid=18944): Terminated: ok {rc=0} 00:26:55.602248 run mk-remote-dir(pid=18945): Launched 00:26:56.790694 run mk-remote-dir(pid=18945): Terminated: ok {rc=0} 00:26:57.093743 run scp-cfg-to-remote(pid=18946): Launched 00:26:58.280057 run scp-cfg-to-remote(pid=18946): Terminated: ok {rc=0} 00:26:58.581862 run scp-db-to-remote(pid=18948): Launched 00:26:59.771970 run scp-db-to-remote(pid=18948): Terminated: ok {rc=0} 00:26:59.911383 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:27:00.238132 run patchelf(pid=18950): Launched 00:27:01.432610 run patchelf(pid=18950): Terminated: ok {rc=0} 00:27:01.605485 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:27:01.985900 run setcap-netadm(pid=18951): Launched 00:27:03.229897 run setcap-netadm(pid=18951): Terminated: ok {rc=0} 00:27:03.573657 run srsepc(pid=18952): Launched 00:27:03.694493 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:27:04.860171 run rm-remote-dir(pid=18953): Launched 00:27:05.045194 run srsepc(pid=18952): ERR: Terminated: ERROR {rc=127} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18952)] 00:27:05.187400 run srsepc(pid=18952): stdout: | (launched: 2022-12-14_00:27:03.514654) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:05.330723 run srsepc(pid=18952): stderr: | (launched: 2022-12-14_00:27:03.563118) | Connection to 10.42.42.116 closed. 00:27:05.473564 run srsepc(pid=18952): stdout: | (launched: 2022-12-14_00:27:03.514654) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:05.610801 run srsepc(pid=18952): stderr: | (launched: 2022-12-14_00:27:03.563118) | Connection to 10.42.42.116 closed. 00:27:05.772749 run rm-remote-dir(pid=18953): Terminating (SIGINT) 00:27:05.960289 run rm-remote-dir(pid=18953): Terminated: ok {rc=0} 00:27:06.096470 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=18952): Process ended prematurely: srsepc(pid=18952) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18952)] [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 00:27:06.107390 tst iperf3_bidir.py:42: Test FAILED (19.1 sec) 00:27:06.187534 run scp-back-log(pid=18954): Launched 00:27:07.267390 run scp-back-log(pid=18954): ERR: Terminated: ERROR {rc=1} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18954)] 00:27:07.332073 run scp-back-log(pid=18954): stdout: | (launched: 2022-12-14_00:27:06.156259) 00:27:07.398082 run scp-back-log(pid=18954): stderr: | (launched: 2022-12-14_00:27:06.177030) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:27:07.471956 tst srsepc_10.42.42.118: Error('scp-back-log(pid=18954): launch_sync(): local process exited with status 1 [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18954)]') ---------------------------------------------- trial-2396 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 00:27:07.520682 tst iperf3_dl.py:13: Number of physical ue: 1 00:27:07.740869 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:27:07.785918 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 00:27:08.003486 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:27:08.019679 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:27:08.052707 tst iperf3_dl.py: using MSISDN 8415 00:27:08.172458 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8415', subscriber_id=0} 00:27:08.287227 run srsepc_10.42.42.118: Starting srsepc 00:27:08.953677 run rm-remote-dir(pid=18956): Launched 00:27:10.142878 run rm-remote-dir(pid=18956): Terminated: ok {rc=0} 00:27:10.498423 run mk-remote-dir(pid=18957): Launched 00:27:11.688086 run mk-remote-dir(pid=18957): Terminated: ok {rc=0} 00:27:11.990419 run scp-inst-to-remote(pid=18958): Launched 00:27:14.178788 run scp-inst-to-remote(pid=18958): Terminated: ok {rc=0} 00:27:14.533458 run rm-remote-dir(pid=18960): Launched 00:27:15.722106 run rm-remote-dir(pid=18960): Terminated: ok {rc=0} 00:27:16.126275 run mk-remote-dir(pid=18961): Launched 00:27:17.429924 run mk-remote-dir(pid=18961): Terminated: ok {rc=0} 00:27:17.733606 run scp-cfg-to-remote(pid=18962): Launched 00:27:18.916421 run scp-cfg-to-remote(pid=18962): Terminated: ok {rc=0} 00:27:19.197445 run scp-db-to-remote(pid=18964): Launched 00:27:20.374414 run scp-db-to-remote(pid=18964): Terminated: ok {rc=0} 00:27:20.504628 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:27:20.809387 run patchelf(pid=18966): Launched 00:27:21.985309 run patchelf(pid=18966): Terminated: ok {rc=0} 00:27:22.115207 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:27:22.419560 run setcap-netadm(pid=18967): Launched 00:27:23.594963 run setcap-netadm(pid=18967): Terminated: ok {rc=0} 00:27:23.914592 run srsepc(pid=18968): Launched 00:27:24.028786 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:27:25.128787 run rm-remote-dir(pid=18969): Launched 00:27:25.305244 run srsepc(pid=18968): ERR: Terminated: ERROR {rc=127} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18968)] 00:27:25.439666 run srsepc(pid=18968): stdout: | (launched: 2022-12-14_00:27:23.859040) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:25.574200 run srsepc(pid=18968): stderr: | (launched: 2022-12-14_00:27:23.904333) | Connection to 10.42.42.116 closed. 00:27:25.708741 run srsepc(pid=18968): stdout: | (launched: 2022-12-14_00:27:23.859040) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:25.836578 run srsepc(pid=18968): stderr: | (launched: 2022-12-14_00:27:23.904333) | Connection to 10.42.42.116 closed. 00:27:25.988524 run rm-remote-dir(pid=18969): Terminating (SIGINT) 00:27:26.164255 run rm-remote-dir(pid=18969): Terminated: ok {rc=0} 00:27:26.290919 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=18968): Process ended prematurely: srsepc(pid=18968) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18968)] [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 00:27:26.300684 tst iperf3_dl.py:42: Test FAILED (18.8 sec) 00:27:26.377940 run scp-back-log(pid=18970): Launched 00:27:27.454859 run scp-back-log(pid=18970): ERR: Terminated: ERROR {rc=1} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18970)] 00:27:27.515649 run scp-back-log(pid=18970): stdout: | (launched: 2022-12-14_00:27:26.347232) 00:27:27.577896 run scp-back-log(pid=18970): stderr: | (launched: 2022-12-14_00:27:26.367295) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:27:27.647878 tst srsepc_10.42.42.118: Error('scp-back-log(pid=18970): launch_sync(): local process exited with status 1 [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18970)]') ---------------------------------------------- trial-2396 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 00:27:27.692399 tst iperf3_ul.py:13: Number of physical ue: 1 00:27:27.895219 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:27:27.937598 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 00:27:28.138653 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:27:28.154338 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:27:28.186770 tst iperf3_ul.py: using MSISDN 8416 00:27:28.307001 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8416', subscriber_id=0} 00:27:28.421651 run srsepc_10.42.42.118: Starting srsepc 00:27:29.089442 run rm-remote-dir(pid=18972): Launched 00:27:30.278860 run rm-remote-dir(pid=18972): Terminated: ok {rc=0} 00:27:30.634685 run mk-remote-dir(pid=18973): Launched 00:27:31.823501 run mk-remote-dir(pid=18973): Terminated: ok {rc=0} 00:27:32.138165 run scp-inst-to-remote(pid=18974): Launched 00:27:34.362277 run scp-inst-to-remote(pid=18974): Terminated: ok {rc=0} 00:27:34.716497 run rm-remote-dir(pid=18976): Launched 00:27:35.905606 run rm-remote-dir(pid=18976): Terminated: ok {rc=0} 00:27:36.260535 run mk-remote-dir(pid=18977): Launched 00:27:37.448905 run mk-remote-dir(pid=18977): Terminated: ok {rc=0} 00:27:37.738016 run scp-cfg-to-remote(pid=18978): Launched 00:27:38.913749 run scp-cfg-to-remote(pid=18978): Terminated: ok {rc=0} 00:27:39.194598 run scp-db-to-remote(pid=18980): Launched 00:27:40.370475 run scp-db-to-remote(pid=18980): Terminated: ok {rc=0} 00:27:40.500268 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:27:40.804364 run patchelf(pid=18982): Launched 00:27:41.980707 run patchelf(pid=18982): Terminated: ok {rc=0} 00:27:42.110927 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:27:42.414959 run setcap-netadm(pid=18983): Launched 00:27:43.590938 run setcap-netadm(pid=18983): Terminated: ok {rc=0} 00:27:43.910653 run srsepc(pid=18984): Launched 00:27:44.024236 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:27:45.125719 run rm-remote-dir(pid=18985): Launched 00:27:45.303069 run srsepc(pid=18984): ERR: Terminated: ERROR {rc=127} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18984)] 00:27:45.438451 run srsepc(pid=18984): stdout: | (launched: 2022-12-14_00:27:43.854974) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:45.573080 run srsepc(pid=18984): stderr: | (launched: 2022-12-14_00:27:43.900029) | Connection to 10.42.42.116 closed. 00:27:45.707965 run srsepc(pid=18984): stdout: | (launched: 2022-12-14_00:27:43.854974) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:45.855080 run srsepc(pid=18984): stderr: | (launched: 2022-12-14_00:27:43.900029) | Connection to 10.42.42.116 closed. 00:27:46.018533 run rm-remote-dir(pid=18985): Terminating (SIGINT) 00:27:46.252274 run rm-remote-dir(pid=18985): Terminated: ok {rc=0} 00:27:46.404194 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=18984): Process ended prematurely: srsepc(pid=18984) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18984)] [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 00:27:46.415941 tst iperf3_ul.py:42: Test FAILED (18.7 sec) 00:27:46.504561 run scp-back-log(pid=18986): Launched 00:27:47.618989 run scp-back-log(pid=18986): ERR: Terminated: ERROR {rc=1} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18986)] 00:27:47.679633 run scp-back-log(pid=18986): stdout: | (launched: 2022-12-14_00:27:46.468327) 00:27:47.741568 run scp-back-log(pid=18986): stderr: | (launched: 2022-12-14_00:27:46.490544) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:27:47.811133 tst srsepc_10.42.42.118: Error('scp-back-log(pid=18986): launch_sync(): local process exited with status 1 [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18986)]') ---------------------------------------------- trial-2396 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 00:27:47.856288 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:27:47.872586 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:27:47.895334 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:27:47.943483 tst ping.py: using MSISDN 8417 00:27:48.065860 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8417', subscriber_id=0} 00:27:48.181582 run srsepc_10.42.42.118: Starting srsepc 00:27:48.851383 run rm-remote-dir(pid=18988): Launched 00:27:50.041540 run rm-remote-dir(pid=18988): Terminated: ok {rc=0} 00:27:50.397879 run mk-remote-dir(pid=18989): Launched 00:27:51.587473 run mk-remote-dir(pid=18989): Terminated: ok {rc=0} 00:27:51.890178 run scp-inst-to-remote(pid=18990): Launched 00:27:54.079412 run scp-inst-to-remote(pid=18990): Terminated: ok {rc=0} 00:27:54.433588 run rm-remote-dir(pid=18992): Launched 00:27:55.623530 run rm-remote-dir(pid=18992): Terminated: ok {rc=0} 00:27:55.979109 run mk-remote-dir(pid=18993): Launched 00:27:57.169018 run mk-remote-dir(pid=18993): Terminated: ok {rc=0} 00:27:57.471617 run scp-cfg-to-remote(pid=18994): Launched 00:27:58.657570 run scp-cfg-to-remote(pid=18994): Terminated: ok {rc=0} 00:27:58.961884 run scp-db-to-remote(pid=18996): Launched 00:28:00.149390 run scp-db-to-remote(pid=18996): Terminated: ok {rc=0} 00:28:00.288797 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:28:00.615787 run patchelf(pid=18998): Launched 00:28:01.819943 run patchelf(pid=18998): Terminated: ok {rc=0} 00:28:01.974762 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:28:02.350165 run setcap-netadm(pid=18999): Launched 00:28:03.537703 run setcap-netadm(pid=18999): Terminated: ok {rc=0} 00:28:03.882351 run srsepc(pid=19000): Launched 00:28:03.999396 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:28:05.109964 run rm-remote-dir(pid=19001): Launched 00:28:05.286238 run srsepc(pid=19000): ERR: Terminated: ERROR {rc=127} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19000)] 00:28:05.421260 run srsepc(pid=19000): stdout: | (launched: 2022-12-14_00:28:03.823478) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:05.556002 run srsepc(pid=19000): stderr: | (launched: 2022-12-14_00:28:03.871641) | Connection to 10.42.42.116 closed. 00:28:05.690577 run srsepc(pid=19000): stdout: | (launched: 2022-12-14_00:28:03.823478) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:05.819045 run srsepc(pid=19000): stderr: | (launched: 2022-12-14_00:28:03.871641) | Connection to 10.42.42.116 closed. 00:28:05.971292 run rm-remote-dir(pid=19001): Terminating (SIGINT) 00:28:06.147433 run rm-remote-dir(pid=19001): Terminated: ok {rc=0} 00:28:06.275004 tst ping.py:16: ERR: Error: srsepc(pid=19000): Process ended prematurely: srsepc(pid=19000) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19000)] [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 00:28:06.284743 tst ping.py:16: Test FAILED (18.4 sec) 00:28:06.361020 run scp-back-log(pid=19002): Launched 00:28:07.437266 run scp-back-log(pid=19002): ERR: Terminated: ERROR {rc=1} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19002)] 00:28:07.498666 run scp-back-log(pid=19002): stdout: | (launched: 2022-12-14_00:28:06.331058) 00:28:07.560801 run scp-back-log(pid=19002): stderr: | (launched: 2022-12-14_00:28:06.350798) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:28:07.630492 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19002): launch_sync(): local process exited with status 1 [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19002)]') ---------------------------------------------- trial-2396 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 00:28:07.675540 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:28:07.691921 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:28:07.714494 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:28:07.766679 tst rrc_idle_mo_ping.py: using MSISDN 8418 00:28:07.880628 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8418', subscriber_id=0} 00:28:07.986483 run srsepc_10.42.42.118: Starting srsepc 00:28:08.607231 run rm-remote-dir(pid=19004): Launched 00:28:09.786533 run rm-remote-dir(pid=19004): Terminated: ok {rc=0} 00:28:10.120259 run mk-remote-dir(pid=19005): Launched 00:28:11.297641 run mk-remote-dir(pid=19005): Terminated: ok {rc=0} 00:28:11.577260 run scp-inst-to-remote(pid=19006): Launched 00:28:13.756294 run scp-inst-to-remote(pid=19006): Terminated: ok {rc=0} 00:28:14.105846 run rm-remote-dir(pid=19008): Launched 00:28:15.291876 run rm-remote-dir(pid=19008): Terminated: ok {rc=0} 00:28:15.643083 run mk-remote-dir(pid=19009): Launched 00:28:16.825634 run mk-remote-dir(pid=19009): Terminated: ok {rc=0} 00:28:17.115954 run scp-cfg-to-remote(pid=19010): Launched 00:28:18.353983 run scp-cfg-to-remote(pid=19010): Terminated: ok {rc=0} 00:28:18.632211 run scp-db-to-remote(pid=19012): Launched 00:28:19.808838 run scp-db-to-remote(pid=19012): Terminated: ok {rc=0} 00:28:19.937396 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:28:20.238118 run patchelf(pid=19014): Launched 00:28:21.412353 run patchelf(pid=19014): Terminated: ok {rc=0} 00:28:21.540767 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:28:21.841564 run setcap-netadm(pid=19015): Launched 00:28:23.014366 run setcap-netadm(pid=19015): Terminated: ok {rc=0} 00:28:23.330367 run srsepc(pid=19016): Launched 00:28:23.447515 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:28:24.531946 run rm-remote-dir(pid=19017): Launched 00:28:24.706376 run srsepc(pid=19016): ERR: Terminated: ERROR {rc=127} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19016)] 00:28:24.839360 run srsepc(pid=19016): stdout: | (launched: 2022-12-14_00:28:23.275982) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:24.971899 run srsepc(pid=19016): stderr: | (launched: 2022-12-14_00:28:23.320348) | Connection to 10.42.42.116 closed. 00:28:25.104207 run srsepc(pid=19016): stdout: | (launched: 2022-12-14_00:28:23.275982) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:25.231033 run srsepc(pid=19016): stderr: | (launched: 2022-12-14_00:28:23.320348) | Connection to 10.42.42.116 closed. 00:28:25.380698 run rm-remote-dir(pid=19017): Terminating (SIGINT) 00:28:25.554531 run rm-remote-dir(pid=19017): Terminated: ok {rc=0} 00:28:25.680116 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=19016): Process ended prematurely: srsepc(pid=19016) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19016)] [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 00:28:25.689948 tst rrc_idle_mo_ping.py:16: Test FAILED (18.0 sec) 00:28:25.765275 run scp-back-log(pid=19018): Launched 00:28:26.841822 run scp-back-log(pid=19018): ERR: Terminated: ERROR {rc=1} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19018)] 00:28:26.902210 run scp-back-log(pid=19018): stdout: | (launched: 2022-12-14_00:28:25.735788) 00:28:26.964010 run scp-back-log(pid=19018): stderr: | (launched: 2022-12-14_00:28:25.755435) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:28:27.033141 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19018): launch_sync(): local process exited with status 1 [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19018)]') ---------------------------------------------- trial-2396 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 00:28:27.077768 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:28:27.094608 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:28:27.117033 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:28:27.166791 tst rrc_idle_mt_ping.py: using MSISDN 8419 00:28:27.279498 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8419', subscriber_id=0} 00:28:27.384358 run srsepc_10.42.42.118: Starting srsepc 00:28:27.997521 run rm-remote-dir(pid=19020): Launched 00:28:29.174360 run rm-remote-dir(pid=19020): Terminated: ok {rc=0} 00:28:29.503910 run mk-remote-dir(pid=19021): Launched 00:28:30.680735 run mk-remote-dir(pid=19021): Terminated: ok {rc=0} 00:28:30.987010 run scp-inst-to-remote(pid=19022): Launched 00:28:33.229885 run scp-inst-to-remote(pid=19022): Terminated: ok {rc=0} 00:28:33.558688 run rm-remote-dir(pid=19024): Launched 00:28:34.735455 run rm-remote-dir(pid=19024): Terminated: ok {rc=0} 00:28:35.064627 run mk-remote-dir(pid=19025): Launched 00:28:36.242322 run mk-remote-dir(pid=19025): Terminated: ok {rc=0} 00:28:36.523017 run scp-cfg-to-remote(pid=19026): Launched 00:28:37.697780 run scp-cfg-to-remote(pid=19026): Terminated: ok {rc=0} 00:28:37.975728 run scp-db-to-remote(pid=19028): Launched 00:28:39.150624 run scp-db-to-remote(pid=19028): Terminated: ok {rc=0} 00:28:39.279923 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:28:39.581898 run patchelf(pid=19030): Launched 00:28:40.755203 run patchelf(pid=19030): Terminated: ok {rc=0} 00:28:40.883587 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:28:41.185760 run setcap-netadm(pid=19031): Launched 00:28:42.359650 run setcap-netadm(pid=19031): Terminated: ok {rc=0} 00:28:42.675651 run srsepc(pid=19032): Launched 00:28:42.788463 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:28:43.935112 run rm-remote-dir(pid=19033): Launched 00:28:44.118606 run srsepc(pid=19032): ERR: Terminated: ERROR {rc=127} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19032)] 00:28:44.259442 run srsepc(pid=19032): stdout: | (launched: 2022-12-14_00:28:42.621276) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:44.400564 run srsepc(pid=19032): stderr: | (launched: 2022-12-14_00:28:42.665808) | Connection to 10.42.42.116 closed. 00:28:44.541733 run srsepc(pid=19032): stdout: | (launched: 2022-12-14_00:28:42.621276) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:44.677378 run srsepc(pid=19032): stderr: | (launched: 2022-12-14_00:28:42.665808) | Connection to 10.42.42.116 closed. 00:28:44.837654 run rm-remote-dir(pid=19033): Terminating (SIGINT) 00:28:45.023339 run rm-remote-dir(pid=19033): Terminated: ok {rc=0} 00:28:45.157418 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=19032): Process ended prematurely: srsepc(pid=19032) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19032)] [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 00:28:45.167930 tst rrc_idle_mt_ping.py:16: Test FAILED (18.1 sec) 00:28:45.247095 run scp-back-log(pid=19034): Launched 00:28:46.323115 run scp-back-log(pid=19034): ERR: Terminated: ERROR {rc=1} [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19034)] 00:28:46.386150 run scp-back-log(pid=19034): stdout: | (launched: 2022-12-14_00:28:45.216310) 00:28:46.450743 run scp-back-log(pid=19034): stderr: | (launched: 2022-12-14_00:28:45.236992) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:28:46.523656 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19034): launch_sync(): local process exited with status 1 [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19034)]') --------------------------------------------------------------------- trial-2396 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 00:28:46.674923 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:28:46.680691 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 00:28:46.740909 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 00:28:46.775704 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 00:28:46.841021 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 00:28:46.914269 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 00:28:46.950288 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 00:28:47.460844 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 00:28:47.467414 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:28:47.479184 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 00:28:47.519525 tst handover.py: using LAC 37280 00:28:47.649371 tst handover.py: using RAC 50 00:28:47.774319 tst handover.py: using CellId 37280 00:28:47.899764 tst handover.py: using BVCI 37281 00:28:48.015256 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 00:28:48.051012 tst handover.py: using LAC 37281 00:28:48.178313 tst handover.py: using RAC 51 00:28:48.304702 tst handover.py: using CellId 37281 00:28:48.429444 tst handover.py: using BVCI 37282 00:28:48.546909 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:28:48.558289 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:28:48.569505 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:28:48.580417 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:28:48.592403 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:28:48.604353 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 00:28:48.721850 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 00:28:48.835442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:28:49.291545 run create_hlr_db(pid=19039): Launched 00:28:50.457808 run create_hlr_db(pid=19039): Terminated: ok {rc=0} 00:28:50.768848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19041): Launched 00:28:51.063026 run osmo-hlr_10.42.42.2(pid=19042): Launched 00:28:51.175167 run osmo-stp_10.42.42.5: Starting osmo-stp 00:28:51.696251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19044): Launched 00:28:51.989857 run osmo-stp_10.42.42.5(pid=19045): Launched 00:28:52.101954 run osmo-msc_10.42.42.6: Starting osmo-msc 00:28:52.633655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19047): Launched 00:28:52.926871 run osmo-msc_10.42.42.6(pid=19048): Launched 00:28:53.090620 run osmo-stp_10.42.42.5(pid=19045): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19045)] 00:28:53.214731 run osmo-stp_10.42.42.5(pid=19045): stdout: | (launched: 2022-12-14_00:28:51.936324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:28:53.339796 run osmo-stp_10.42.42.5(pid=19045): stderr: | [0;m[38;5;43m20221214002852105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002852106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002852106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002852106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002852107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002852107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002852107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:28:53.463474 run osmo-stp_10.42.42.5(pid=19045): stdout: | (launched: 2022-12-14_00:28:51.936324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:28:53.581237 run osmo-stp_10.42.42.5(pid=19045): stderr: | [0;m[38;5;43m20221214002852105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002852106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002852106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002852106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002852107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002852107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002852107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:28:53.721176 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19045): Process ended prematurely: osmo-stp_10.42.42.5(pid=19045) [trial-2396↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19045)] [trial-2396↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 00:28:53.729404 tst handover.py:18: Test FAILED (6.3 sec) 00:28:53.754881 run osmo-hlr_10.42.42.2(pid=19042): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19042)] 00:28:53.802022 run osmo-hlr_10.42.42.2(pid=19042): stdout: | (launched: 2022-12-14_00:28:51.009457) 00:28:53.850800 run osmo-hlr_10.42.42.2(pid=19042): stderr: | [0;m[1;31m20221214002851183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002851183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002851183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002851183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002851183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002851183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002851200 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002851209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002851210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002851210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:28:53.918650 run osmo-msc_10.42.42.6(pid=19048): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19048)] 00:28:53.965217 run osmo-msc_10.42.42.6(pid=19048): stdout: | (launched: 2022-12-14_00:28:52.873319) 00:28:54.013711 run osmo-msc_10.42.42.6(pid=19048): stderr: | [0;m[38;5;43m20221214002853143 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002853143 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feae5c29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002853143 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002853143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002853144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002853144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002853146 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002853146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002853146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002853146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:28:54.062402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19041): Terminating (SIGTERM) 00:28:54.101246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19044): Terminating (SIGTERM) 00:28:54.140148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19047): Terminating (SIGTERM) 00:28:54.179187 --- ParallelTerminationStrategy: PID 19041 died... 00:28:54.198088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19041): Terminated: ok {rc=0} 00:28:54.241451 --- ParallelTerminationStrategy: PID 19044 died... 00:28:54.259775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19044): Terminated: ok {rc=0} 00:28:54.302898 --- ParallelTerminationStrategy: PID 19047 died... 00:28:54.321323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19047): Terminated: ok {rc=0} 00:28:54.405472 bus /sierra_3: Setting Powered False 00:28:55.503186 bus /sierra_3: Setting Powered False 00:28:56.616774 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 00:28:57.856170 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:28:57.861958 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 00:28:57.900823 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 00:28:57.926825 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 00:28:57.975167 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 00:28:58.013682 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 00:28:58.039503 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 00:28:58.594777 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 00:28:58.600157 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:28:58.610950 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 00:28:58.646331 tst handover.py: using LAC 37282 00:28:58.761355 tst handover.py: using RAC 52 00:28:58.877464 tst handover.py: using CellId 37282 00:28:59.001361 tst handover.py: using BVCI 37283 00:28:59.116237 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 00:28:59.149900 tst handover.py: using LAC 37283 00:28:59.274804 tst handover.py: using RAC 53 00:28:59.397903 tst handover.py: using CellId 37283 00:28:59.521060 tst handover.py: using BVCI 37284 00:28:59.637015 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:28:59.648151 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:28:59.659175 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:28:59.670272 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:28:59.681716 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:28:59.692878 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 00:28:59.809649 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 00:28:59.925874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:00.360320 run create_hlr_db(pid=19054): Launched 00:29:00.473890 bus /sierra_2: Setting Powered False 00:29:01.531555 run create_hlr_db(pid=19054): Terminated: ok {rc=0} 00:29:01.936480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19056): Launched 00:29:02.252874 run osmo-hlr_10.42.42.2(pid=19057): Launched 00:29:02.367235 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:02.851093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19059): Launched 00:29:03.145420 run osmo-stp_10.42.42.5(pid=19060): Launched 00:29:03.257383 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:03.766768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19062): Launched 00:29:04.061591 run osmo-msc_10.42.42.6(pid=19063): Launched 00:29:04.227285 run osmo-stp_10.42.42.5(pid=19060): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19060)] 00:29:04.353871 run osmo-stp_10.42.42.5(pid=19060): stdout: | (launched: 2022-12-14_00:29:03.091732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:04.479433 run osmo-stp_10.42.42.5(pid=19060): stderr: | [0;m[38;5;43m20221214002903262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002903262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002903262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002903262 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002903263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002903263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002903263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:04.602916 run osmo-stp_10.42.42.5(pid=19060): stdout: | (launched: 2022-12-14_00:29:03.091732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:04.720593 run osmo-stp_10.42.42.5(pid=19060): stderr: | [0;m[38;5;43m20221214002903262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002903262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002903262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002903262 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002903263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002903263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002903263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:04.861394 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19060): Process ended prematurely: osmo-stp_10.42.42.5(pid=19060) [trial-2396↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19060)] [trial-2396↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 00:29:04.869645 tst handover.py:18: Test FAILED (6.3 sec) 00:29:04.895096 run osmo-hlr_10.42.42.2(pid=19057): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19057)] 00:29:04.942036 run osmo-hlr_10.42.42.2(pid=19057): stdout: | (launched: 2022-12-14_00:29:02.198311) 00:29:04.990768 run osmo-hlr_10.42.42.2(pid=19057): stderr: | [0;m[1;31m20221214002902372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002902372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002902372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002902372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002902372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002902372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002902385 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002902393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002902394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002902394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:05.058656 run osmo-msc_10.42.42.6(pid=19063): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19063)] 00:29:05.105585 run osmo-msc_10.42.42.6(pid=19063): stdout: | (launched: 2022-12-14_00:29:04.007859) 00:29:05.153938 run osmo-msc_10.42.42.6(pid=19063): stderr: | [0;m[38;5;43m20221214002904277 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002904277 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f36e3937c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002904277 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002904277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002904277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002904277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002904279 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002904281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002904281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002904281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:05.202690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19056): Terminating (SIGTERM) 00:29:05.241495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19059): Terminating (SIGTERM) 00:29:05.280264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19062): Terminating (SIGTERM) 00:29:05.319672 --- ParallelTerminationStrategy: PID 19056 died... 00:29:05.338424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19056): Terminated: ok {rc=0} 00:29:05.381683 --- ParallelTerminationStrategy: PID 19059 died... 00:29:05.399860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19059): Terminated: ok {rc=0} 00:29:05.442817 --- ParallelTerminationStrategy: PID 19062 died... 00:29:05.461271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19062): Terminated: ok {rc=0} 00:29:05.546238 bus /sierra_3: Setting Powered False 00:29:06.644671 bus /sierra_3: Setting Powered False 00:29:07.755862 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 00:29:09.001824 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:09.007351 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 00:29:09.062087 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 00:29:09.089229 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 00:29:09.141015 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 00:29:09.193771 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 00:29:09.219654 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 00:29:09.774288 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 00:29:09.779908 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:09.791158 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:29:09.832115 tst handover.py: using LAC 37284 00:29:09.954770 tst handover.py: using RAC 54 00:29:10.070371 tst handover.py: using CellId 37284 00:29:10.185407 tst handover.py: using BVCI 37285 00:29:10.292348 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:29:10.338955 tst handover.py: using LAC 37285 00:29:10.453625 tst handover.py: using RAC 55 00:29:10.568305 tst handover.py: using CellId 37285 00:29:10.683352 tst handover.py: using BVCI 37286 00:29:10.800444 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:10.811950 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:10.823143 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:10.834447 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:10.846597 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:10.858299 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:29:10.973722 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:29:11.091236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:11.553091 run create_hlr_db(pid=19069): Launched 00:29:11.674292 bus /sierra_2: Setting Powered False 00:29:12.737356 run create_hlr_db(pid=19069): Terminated: ok {rc=0} 00:29:13.134365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19071): Launched 00:29:13.429241 run osmo-hlr_10.42.42.2(pid=19072): Launched 00:29:13.541344 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:14.024556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19074): Launched 00:29:14.317543 run osmo-stp_10.42.42.5(pid=19075): Launched 00:29:14.429817 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:14.937605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19077): Launched 00:29:15.231923 run osmo-msc_10.42.42.6(pid=19078): Launched 00:29:15.397055 run osmo-stp_10.42.42.5(pid=19075): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19075)] 00:29:15.522560 run osmo-stp_10.42.42.5(pid=19075): stdout: | (launched: 2022-12-14_00:29:14.263885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:15.649179 run osmo-stp_10.42.42.5(pid=19075): stderr: | [0;m[38;5;43m20221214002914433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002914433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002914433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002914434 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002914434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002914434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002914434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:15.772101 run osmo-stp_10.42.42.5(pid=19075): stdout: | (launched: 2022-12-14_00:29:14.263885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:15.896486 run osmo-stp_10.42.42.5(pid=19075): stderr: | [0;m[38;5;43m20221214002914433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002914433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002914433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002914434 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002914434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002914434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002914434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:16.039108 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19075): Process ended prematurely: osmo-stp_10.42.42.5(pid=19075) [trial-2396↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19075)] [trial-2396↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 00:29:16.047523 tst handover.py:18: Test FAILED (6.3 sec) 00:29:16.073532 run osmo-hlr_10.42.42.2(pid=19072): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19072)] 00:29:16.121335 run osmo-hlr_10.42.42.2(pid=19072): stdout: | (launched: 2022-12-14_00:29:13.375298) 00:29:16.170698 run osmo-hlr_10.42.42.2(pid=19072): stderr: | [0;m[1;31m20221214002913551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002913551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002913551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002913551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002913551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002913551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002913563 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002913572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002913572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002913572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:16.239578 run osmo-msc_10.42.42.6(pid=19078): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19078)] 00:29:16.287392 run osmo-msc_10.42.42.6(pid=19078): stdout: | (launched: 2022-12-14_00:29:15.178053) 00:29:16.336798 run osmo-msc_10.42.42.6(pid=19078): stderr: | [0;m[38;5;43m20221214002915449 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002915449 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe3c0662c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002915449 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002915449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002915449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002915449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002915451 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002915452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002915452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002915452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:16.393076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19071): Terminating (SIGTERM) 00:29:16.451396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19074): Terminating (SIGTERM) 00:29:16.510107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19077): Terminating (SIGTERM) 00:29:16.564559 --- ParallelTerminationStrategy: PID 19071 died... 00:29:16.592250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19071): Terminated: ok {rc=0} 00:29:16.655630 --- ParallelTerminationStrategy: PID 19074 died... 00:29:16.683203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19074): Terminated: ok {rc=0} 00:29:16.742156 --- ParallelTerminationStrategy: PID 19077 died... 00:29:16.767689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19077): Terminated: ok {rc=0} 00:29:16.877201 bus /sierra_3: Setting Powered False 00:29:17.982038 bus /sierra_3: Setting Powered False 00:29:19.097592 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 00:29:20.357706 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:20.363247 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 00:29:20.414138 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:29:20.441216 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:29:20.492619 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 00:29:20.543088 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:29:20.570440 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:29:21.119189 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 00:29:21.124408 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:21.135472 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:29:21.171879 tst handover.py: using LAC 37286 00:29:21.288645 tst handover.py: using RAC 56 00:29:21.405114 tst handover.py: using CellId 37286 00:29:21.520937 tst handover.py: using BVCI 37287 00:29:21.628178 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:29:21.672753 tst handover.py: using LAC 37287 00:29:21.789169 tst handover.py: using RAC 57 00:29:21.905761 tst handover.py: using CellId 37287 00:29:22.025232 tst handover.py: using BVCI 37288 00:29:22.132459 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:22.143492 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:22.154244 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:22.165024 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:22.175790 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:22.186639 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:29:22.305737 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:29:22.419460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:22.851176 run create_hlr_db(pid=19083): Launched 00:29:22.971215 bus /sierra_2: Setting Powered False 00:29:24.030067 run create_hlr_db(pid=19083): Terminated: ok {rc=0} 00:29:24.417919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19085): Launched 00:29:24.713275 run osmo-hlr_10.42.42.2(pid=19086): Launched 00:29:24.824866 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:25.306138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19088): Launched 00:29:25.600361 run osmo-stp_10.42.42.5(pid=19089): Launched 00:29:25.713576 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:26.226604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19091): Launched 00:29:26.521144 run osmo-msc_10.42.42.6(pid=19092): Launched 00:29:26.686706 run osmo-stp_10.42.42.5(pid=19089): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19089)] 00:29:26.812048 run osmo-stp_10.42.42.5(pid=19089): stdout: | (launched: 2022-12-14_00:29:25.546376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:26.937300 run osmo-stp_10.42.42.5(pid=19089): stderr: | [0;m[38;5;43m20221214002925719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002925719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002925719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002925720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002925720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002925720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002925720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:27.060563 run osmo-stp_10.42.42.5(pid=19089): stdout: | (launched: 2022-12-14_00:29:25.546376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:27.178124 run osmo-stp_10.42.42.5(pid=19089): stderr: | [0;m[38;5;43m20221214002925719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002925719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002925719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002925720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002925720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002925720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002925720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:27.318390 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19089): Process ended prematurely: osmo-stp_10.42.42.5(pid=19089) [trial-2396↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19089)] [trial-2396↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 00:29:27.326556 tst handover.py:18: Test FAILED (6.2 sec) 00:29:27.352190 run osmo-hlr_10.42.42.2(pid=19086): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19086)] 00:29:27.399616 run osmo-hlr_10.42.42.2(pid=19086): stdout: | (launched: 2022-12-14_00:29:24.659025) 00:29:27.448662 run osmo-hlr_10.42.42.2(pid=19086): stderr: | [0;m[1;31m20221214002924836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002924836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002924836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002924836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002924836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002924836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002924876 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002924886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002924887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002924887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:27.521584 run osmo-msc_10.42.42.6(pid=19092): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19092)] 00:29:27.571377 run osmo-msc_10.42.42.6(pid=19092): stdout: | (launched: 2022-12-14_00:29:26.467302) 00:29:27.623996 run osmo-msc_10.42.42.6(pid=19092): stderr: | [0;m[38;5;43m20221214002926739 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002926739 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f85d0383c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002926739 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002926739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002926739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002926739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002926741 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002926742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002926742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002926742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:27.675955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19085): Terminating (SIGTERM) 00:29:27.717372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19088): Terminating (SIGTERM) 00:29:27.759129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19091): Terminating (SIGTERM) 00:29:27.801200 --- ParallelTerminationStrategy: PID 19085 died... 00:29:27.821090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19085): Terminated: ok {rc=0} 00:29:27.866868 --- ParallelTerminationStrategy: PID 19088 died... 00:29:27.886504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19088): Terminated: ok {rc=0} 00:29:27.932148 --- ParallelTerminationStrategy: PID 19091 died... 00:29:27.951676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19091): Terminated: ok {rc=0} 00:29:28.037971 bus /sierra_3: Setting Powered False 00:29:29.134460 bus /sierra_3: Setting Powered False 00:29:30.245760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:29:31.544607 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:31.552761 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:29:31.627629 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:29:31.661117 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:29:31.732212 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:29:31.835865 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:29:31.867836 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:29:32.361107 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:29:32.366033 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:32.376825 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:29:32.415065 tst handover.py: using LAC 37288 00:29:32.532720 tst handover.py: using RAC 58 00:29:32.651990 tst handover.py: using CellId 37288 00:29:32.769028 tst handover.py: using BVCI 37289 00:29:32.875788 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:29:32.924188 tst handover.py: using LAC 37289 00:29:33.040879 tst handover.py: using RAC 59 00:29:33.156757 tst handover.py: using CellId 37289 00:29:33.271887 tst handover.py: using BVCI 37290 00:29:33.378875 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:33.389845 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:33.400463 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:33.411178 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:33.421858 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:33.432467 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:29:33.552337 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:29:33.668160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:34.100714 run create_hlr_db(pid=19097): Launched 00:29:34.221417 bus /sierra_2: Setting Powered False 00:29:35.280571 run create_hlr_db(pid=19097): Terminated: ok {rc=0} 00:29:35.686413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19099): Launched 00:29:36.001378 run osmo-hlr_10.42.42.2(pid=19100): Launched 00:29:36.121808 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:36.641617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19102): Launched 00:29:36.956299 run osmo-stp_10.42.42.5(pid=19103): Launched 00:29:37.076680 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:37.619664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19105): Launched 00:29:37.934996 run osmo-msc_10.42.42.6(pid=19106): Launched 00:29:38.111166 run osmo-stp_10.42.42.5(pid=19103): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19103)] 00:29:38.244519 run osmo-stp_10.42.42.5(pid=19103): stdout: | (launched: 2022-12-14_00:29:36.899329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:38.378383 run osmo-stp_10.42.42.5(pid=19103): stderr: | [0;m[38;5;43m20221214002937089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002937089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002937089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002937090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002937090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002937090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002937090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:38.511312 run osmo-stp_10.42.42.5(pid=19103): stdout: | (launched: 2022-12-14_00:29:36.899329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:38.637494 run osmo-stp_10.42.42.5(pid=19103): stderr: | [0;m[38;5;43m20221214002937089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002937089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002937089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002937090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002937090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002937090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002937090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:38.787723 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19103): Process ended prematurely: osmo-stp_10.42.42.5(pid=19103) [trial-2396↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19103)] [trial-2396↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 00:29:38.796274 tst handover.py:18: Test FAILED (6.4 sec) 00:29:38.822957 run osmo-hlr_10.42.42.2(pid=19100): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19100)] 00:29:38.872484 run osmo-hlr_10.42.42.2(pid=19100): stdout: | (launched: 2022-12-14_00:29:35.944389) 00:29:38.923371 run osmo-hlr_10.42.42.2(pid=19100): stderr: | [0;m[1;31m20221214002936141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002936142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002936142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002936142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002936142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002936142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002936154 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002936163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002936163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002936163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:38.994683 run osmo-msc_10.42.42.6(pid=19106): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19106)] 00:29:39.043437 run osmo-msc_10.42.42.6(pid=19106): stdout: | (launched: 2022-12-14_00:29:37.878153) 00:29:39.094455 run osmo-msc_10.42.42.6(pid=19106): stderr: | [0;m[38;5;43m20221214002938196 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002938196 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe75475dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002938197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002938197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002938197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002938197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002938199 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002938199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002938199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002938199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:39.145695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19099): Terminating (SIGTERM) 00:29:39.186931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19102): Terminating (SIGTERM) 00:29:39.228077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19105): Terminating (SIGTERM) 00:29:39.269398 --- ParallelTerminationStrategy: PID 19099 died... 00:29:39.289407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19099): Terminated: ok {rc=0} 00:29:39.334981 --- ParallelTerminationStrategy: PID 19102 died... 00:29:39.354457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19102): Terminated: ok {rc=0} 00:29:39.399828 --- ParallelTerminationStrategy: PID 19105 died... 00:29:39.419096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19105): Terminated: ok {rc=0} 00:29:39.505534 bus /sierra_3: Setting Powered False 00:29:40.602685 bus /sierra_3: Setting Powered False 00:29:41.715946 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 00:29:42.978246 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:42.983384 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:29:43.024093 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:29:43.050243 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:29:43.099602 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:29:43.140207 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:29:43.166189 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:29:43.717833 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 00:29:43.722889 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:29:43.733566 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 00:29:43.769888 tst handover.py: using LAC 37290 00:29:43.885517 tst handover.py: using RAC 60 00:29:44.009099 tst handover.py: using CellId 37290 00:29:44.124785 tst handover.py: using BVCI 37291 00:29:44.231781 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 00:29:44.264820 tst handover.py: using LAC 37291 00:29:44.378519 tst handover.py: using RAC 61 00:29:44.496006 tst handover.py: using CellId 37291 00:29:44.610284 tst handover.py: using BVCI 37292 00:29:44.718473 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:29:44.729102 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:29:44.739483 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:29:44.749964 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:29:44.760429 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:29:44.770883 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 00:29:44.885433 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 00:29:45.003467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:45.467056 run create_hlr_db(pid=19112): Launched 00:29:45.589109 bus /sierra_2: Setting Powered False 00:29:46.683207 run create_hlr_db(pid=19112): Terminated: ok {rc=0} 00:29:47.129937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19114): Launched 00:29:47.433893 run osmo-hlr_10.42.42.2(pid=19115): Launched 00:29:47.546447 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:48.047139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19117): Launched 00:29:48.340457 run osmo-stp_10.42.42.5(pid=19118): Launched 00:29:48.452340 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:48.958939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19120): Launched 00:29:49.254306 run osmo-msc_10.42.42.6(pid=19121): Launched 00:29:49.419440 run osmo-stp_10.42.42.5(pid=19118): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19118)] 00:29:49.544925 run osmo-stp_10.42.42.5(pid=19118): stdout: | (launched: 2022-12-14_00:29:48.286921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:49.671188 run osmo-stp_10.42.42.5(pid=19118): stderr: | [0;m[38;5;43m20221214002948455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002948455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002948455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002948456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002948456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002948456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002948456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:49.793988 run osmo-stp_10.42.42.5(pid=19118): stdout: | (launched: 2022-12-14_00:29:48.286921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:49.912349 run osmo-stp_10.42.42.5(pid=19118): stderr: | [0;m[38;5;43m20221214002948455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002948455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002948455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002948456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002948456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002948456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002948456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:50.053230 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19118): Process ended prematurely: osmo-stp_10.42.42.5(pid=19118) [trial-2396↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19118)] [trial-2396↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 00:29:50.061476 tst handover.py:18: Test FAILED (6.3 sec) 00:29:50.086943 run osmo-hlr_10.42.42.2(pid=19115): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19115)] 00:29:50.134368 run osmo-hlr_10.42.42.2(pid=19115): stdout: | (launched: 2022-12-14_00:29:47.379874) 00:29:50.182746 run osmo-hlr_10.42.42.2(pid=19115): stderr: | [0;m[1;31m20221214002947555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002947555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002947555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002947555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002947555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002947555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002947567 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002947577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002947577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002947577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:50.250308 run osmo-msc_10.42.42.6(pid=19121): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19121)] 00:29:50.296888 run osmo-msc_10.42.42.6(pid=19121): stdout: | (launched: 2022-12-14_00:29:49.200009) 00:29:50.345358 run osmo-msc_10.42.42.6(pid=19121): stderr: | [0;m[38;5;43m20221214002949472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214002949472 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd62f8c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214002949472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214002949472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214002949472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214002949473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214002949474 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214002949475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214002949475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214002949475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:50.394121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19114): Terminating (SIGTERM) 00:29:50.433133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19117): Terminating (SIGTERM) 00:29:50.472022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19120): Terminating (SIGTERM) 00:29:50.511365 --- ParallelTerminationStrategy: PID 19114 died... 00:29:50.530234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19114): Terminated: ok {rc=0} 00:29:50.573965 --- ParallelTerminationStrategy: PID 19117 died... 00:29:50.592337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19117): Terminated: ok {rc=0} 00:29:50.636299 --- ParallelTerminationStrategy: PID 19120 died... 00:29:50.654863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19120): Terminated: ok {rc=0} 00:29:50.737481 bus /sierra_3: Setting Powered False 00:29:51.835014 bus /sierra_3: Setting Powered False 00:29:52.954765 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 00:29:54.200553 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:54.205835 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:29:54.257930 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:29:54.284067 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:29:54.335432 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:29:54.388833 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:29:54.415034 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:29:54.969349 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 00:29:54.975313 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:29:54.987023 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:29:55.025604 tst handover.py: using LAC 37292 00:29:55.150495 tst handover.py: using RAC 62 00:29:55.273861 tst handover.py: using CellId 37292 00:29:55.399173 tst handover.py: using BVCI 37293 00:29:55.514249 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:29:55.562565 tst handover.py: using LAC 37293 00:29:55.689083 tst handover.py: using RAC 63 00:29:55.814248 tst handover.py: using CellId 37293 00:29:55.939896 tst handover.py: using BVCI 37294 00:29:56.056323 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:29:56.067696 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:29:56.078848 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:29:56.089831 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:29:56.101230 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:29:56.112394 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:29:56.228413 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:29:56.343620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:56.776620 run create_hlr_db(pid=19126): Launched 00:29:56.897930 bus /sierra_2: Setting Powered False 00:29:57.957590 run create_hlr_db(pid=19126): Terminated: ok {rc=0} 00:29:58.362860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19128): Launched 00:29:58.678023 run osmo-hlr_10.42.42.2(pid=19129): Launched 00:29:58.798487 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:59.313273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19131): Launched 00:29:59.628412 run osmo-stp_10.42.42.5(pid=19132): Launched 00:29:59.748631 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:00.292788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19134): Launched 00:30:00.608805 run osmo-msc_10.42.42.6(pid=19135): Launched 00:30:00.786256 run osmo-stp_10.42.42.5(pid=19132): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19132)] 00:30:01.023707 run osmo-stp_10.42.42.5(pid=19132): stdout: | (launched: 2022-12-14_00:29:59.571275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:01.284340 run osmo-stp_10.42.42.5(pid=19132): stderr: | [0;m[38;5;43m20221214002959762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002959762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002959763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002959763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002959763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002959764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002959764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:01.422855 run osmo-stp_10.42.42.5(pid=19132): stdout: | (launched: 2022-12-14_00:29:59.571275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:01.552597 run osmo-stp_10.42.42.5(pid=19132): stderr: | [0;m[38;5;43m20221214002959762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214002959762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214002959763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214002959763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214002959763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214002959764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214002959764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:01.708185 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19132): Process ended prematurely: osmo-stp_10.42.42.5(pid=19132) [trial-2396↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19132)] [trial-2396↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 00:30:01.717921 tst handover.py:18: Test FAILED (6.7 sec) 00:30:01.745988 run osmo-hlr_10.42.42.2(pid=19129): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19129)] 00:30:01.800678 run osmo-hlr_10.42.42.2(pid=19129): stdout: | (launched: 2022-12-14_00:29:58.621039) 00:30:01.854993 run osmo-hlr_10.42.42.2(pid=19129): stderr: | [0;m[1;31m20221214002958819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214002958819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214002958819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214002958819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214002958819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214002958819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214002958832 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214002958840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214002958840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214002958840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:01.930073 run osmo-msc_10.42.42.6(pid=19135): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19135)] 00:30:01.981060 run osmo-msc_10.42.42.6(pid=19135): stdout: | (launched: 2022-12-14_00:30:00.551451) 00:30:02.035573 run osmo-msc_10.42.42.6(pid=19135): stderr: | [0;m[38;5;43m20221214003000875 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003000875 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f73d4fd3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003000875 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003000875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003000877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003000878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003000879 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003000884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003000884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003000884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:02.089818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19128): Terminating (SIGTERM) 00:30:02.132298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19131): Terminating (SIGTERM) 00:30:02.175739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19134): Terminating (SIGTERM) 00:30:02.219776 --- ParallelTerminationStrategy: PID 19128 died... 00:30:02.241570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19128): Terminated: ok {rc=0} 00:30:02.290007 --- ParallelTerminationStrategy: PID 19131 died... 00:30:02.311367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19131): Terminated: ok {rc=0} 00:30:02.359871 --- ParallelTerminationStrategy: PID 19134 died... 00:30:02.380701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19134): Terminated: ok {rc=0} 00:30:02.469315 bus /sierra_3: Setting Powered False 00:30:03.566415 bus /sierra_3: Setting Powered False 00:30:04.681102 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 00:30:05.945321 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:05.951733 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:30:06.006436 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:30:06.033400 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:30:06.083432 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:30:06.137154 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:30:06.164011 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:30:06.718831 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 00:30:06.724294 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:30:06.735631 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:30:06.773354 tst handover.py: using LAC 37294 00:30:06.897160 tst handover.py: using RAC 64 00:30:07.019327 tst handover.py: using CellId 37294 00:30:07.134645 tst handover.py: using BVCI 37295 00:30:07.241751 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:30:07.287604 tst handover.py: using LAC 37295 00:30:07.402886 tst handover.py: using RAC 65 00:30:07.518391 tst handover.py: using CellId 37295 00:30:07.633172 tst handover.py: using BVCI 37296 00:30:07.740435 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:30:07.751280 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:30:07.761821 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:30:07.772255 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:30:07.782862 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:30:07.794004 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:30:07.912390 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:30:08.029582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:08.462097 run create_hlr_db(pid=19144): Launched 00:30:08.583015 bus /sierra_2: Setting Powered False 00:30:09.641957 run create_hlr_db(pid=19144): Terminated: ok {rc=0} 00:30:10.047105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19146): Launched 00:30:10.362838 run osmo-hlr_10.42.42.2(pid=19147): Launched 00:30:10.483577 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:11.003874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19149): Launched 00:30:11.320032 run osmo-stp_10.42.42.5(pid=19150): Launched 00:30:11.441492 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:11.985851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19152): Launched 00:30:12.302219 run osmo-msc_10.42.42.6(pid=19153): Launched 00:30:12.478462 run osmo-stp_10.42.42.5(pid=19150): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19150)] 00:30:12.613813 run osmo-stp_10.42.42.5(pid=19150): stdout: | (launched: 2022-12-14_00:30:11.262372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:12.748630 run osmo-stp_10.42.42.5(pid=19150): stderr: | [0;m[38;5;43m20221214003011454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003011455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003011455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003011455 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003011456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003011456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003011456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:12.882650 run osmo-stp_10.42.42.5(pid=19150): stdout: | (launched: 2022-12-14_00:30:11.262372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:13.008460 run osmo-stp_10.42.42.5(pid=19150): stderr: | [0;m[38;5;43m20221214003011454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003011455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003011455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003011455 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003011456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003011456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003011456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:13.159168 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19150): Process ended prematurely: osmo-stp_10.42.42.5(pid=19150) [trial-2396↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19150)] [trial-2396↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 00:30:13.168007 tst handover.py:18: Test FAILED (6.4 sec) 00:30:13.194974 run osmo-hlr_10.42.42.2(pid=19147): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19147)] 00:30:13.244895 run osmo-hlr_10.42.42.2(pid=19147): stdout: | (launched: 2022-12-14_00:30:10.305924) 00:30:13.296446 run osmo-hlr_10.42.42.2(pid=19147): stderr: | [0;m[1;31m20221214003010504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003010504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003010504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003010504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003010504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003010504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003010516 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003010524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003010524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003010525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:13.367782 run osmo-msc_10.42.42.6(pid=19153): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19153)] 00:30:13.416742 run osmo-msc_10.42.42.6(pid=19153): stdout: | (launched: 2022-12-14_00:30:12.245181) 00:30:13.468004 run osmo-msc_10.42.42.6(pid=19153): stderr: | [0;m[38;5;43m20221214003012563 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003012563 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f70684b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003012563 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003012563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003012564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003012564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003012566 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003012566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003012567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003012567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:13.519639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19146): Terminating (SIGTERM) 00:30:13.560681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19149): Terminating (SIGTERM) 00:30:13.602372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19152): Terminating (SIGTERM) 00:30:13.644925 --- ParallelTerminationStrategy: PID 19146 died... 00:30:13.665617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19146): Terminated: ok {rc=0} 00:30:13.711779 --- ParallelTerminationStrategy: PID 19149 died... 00:30:13.731503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19149): Terminated: ok {rc=0} 00:30:13.777450 --- ParallelTerminationStrategy: PID 19152 died... 00:30:13.796875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19152): Terminated: ok {rc=0} 00:30:13.884335 bus /sierra_3: Setting Powered False 00:30:14.982305 bus /sierra_3: Setting Powered False 00:30:16.111077 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 00:30:17.383058 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:17.387756 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 00:30:17.423438 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 00:30:17.449663 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 00:30:17.499779 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 00:30:17.536071 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 00:30:17.562606 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 00:30:18.113350 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 00:30:18.118327 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:18.128847 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 00:30:18.166056 tst handover.py: using LAC 37296 00:30:18.289963 tst handover.py: using RAC 66 00:30:18.412321 tst handover.py: using CellId 37296 00:30:18.538358 tst handover.py: using BVCI 37297 00:30:18.655454 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 00:30:18.688247 tst handover.py: using LAC 37297 00:30:18.810327 tst handover.py: using RAC 67 00:30:18.932565 tst handover.py: using CellId 37297 00:30:19.054182 tst handover.py: using BVCI 37298 00:30:19.169080 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:19.180125 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:19.191090 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:19.202011 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:19.213298 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:19.224590 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 00:30:19.343625 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 00:30:19.458224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:19.895515 run create_hlr_db(pid=19158): Launched 00:30:20.019065 bus /sierra_2: Setting Powered False 00:30:21.081753 run create_hlr_db(pid=19158): Terminated: ok {rc=0} 00:30:21.495715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19160): Launched 00:30:21.811337 run osmo-hlr_10.42.42.2(pid=19161): Launched 00:30:21.932209 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:22.448305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19163): Launched 00:30:22.765317 run osmo-stp_10.42.42.5(pid=19164): Launched 00:30:22.886602 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:23.432729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19166): Launched 00:30:23.749506 run osmo-msc_10.42.42.6(pid=19167): Launched 00:30:23.926539 run osmo-stp_10.42.42.5(pid=19164): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19164)] 00:30:24.061280 run osmo-stp_10.42.42.5(pid=19164): stdout: | (launched: 2022-12-14_00:30:22.708158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:24.196421 run osmo-stp_10.42.42.5(pid=19164): stderr: | [0;m[38;5;43m20221214003022899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003022899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003022899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003022899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003022902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003022902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003022902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:24.331314 run osmo-stp_10.42.42.5(pid=19164): stdout: | (launched: 2022-12-14_00:30:22.708158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:24.457862 run osmo-stp_10.42.42.5(pid=19164): stderr: | [0;m[38;5;43m20221214003022899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003022899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003022899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003022899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003022902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003022902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003022902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:24.609016 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19164): Process ended prematurely: osmo-stp_10.42.42.5(pid=19164) [trial-2396↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19164)] [trial-2396↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 00:30:24.617938 tst handover.py:18: Test FAILED (6.5 sec) 00:30:24.644659 run osmo-hlr_10.42.42.2(pid=19161): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19161)] 00:30:24.694637 run osmo-hlr_10.42.42.2(pid=19161): stdout: | (launched: 2022-12-14_00:30:21.754434) 00:30:24.745685 run osmo-hlr_10.42.42.2(pid=19161): stderr: | [0;m[1;31m20221214003021953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003021953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003021953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003021953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003021953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003021953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003021966 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003021974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003021974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003021975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:24.817252 run osmo-msc_10.42.42.6(pid=19167): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19167)] 00:30:24.866226 run osmo-msc_10.42.42.6(pid=19167): stdout: | (launched: 2022-12-14_00:30:23.692205) 00:30:24.917509 run osmo-msc_10.42.42.6(pid=19167): stderr: | [0;m[38;5;43m20221214003024013 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003024013 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30c769dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003024013 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003024014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003024014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003024014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003024015 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003024016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003024016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003024016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:24.969114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19160): Terminating (SIGTERM) 00:30:25.010327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19163): Terminating (SIGTERM) 00:30:25.051680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19166): Terminating (SIGTERM) 00:30:25.094009 --- ParallelTerminationStrategy: PID 19160 died... 00:30:25.114318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19160): Terminated: ok {rc=0} 00:30:25.160185 --- ParallelTerminationStrategy: PID 19163 died... 00:30:25.179751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19163): Terminated: ok {rc=0} 00:30:25.225744 --- ParallelTerminationStrategy: PID 19166 died... 00:30:25.245401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19166): Terminated: ok {rc=0} 00:30:25.333353 bus /sierra_3: Setting Powered False 00:30:26.429528 bus /sierra_3: Setting Powered False 00:30:27.543313 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 00:30:28.783260 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:28.788569 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 00:30:28.840066 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 00:30:28.867035 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 00:30:28.919631 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 00:30:28.971237 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 00:30:28.998295 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 00:30:29.545635 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 00:30:29.550858 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:29.561794 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:30:29.595317 tst handover.py: using LAC 37298 00:30:29.722034 tst handover.py: using RAC 68 00:30:29.847998 tst handover.py: using CellId 37298 00:30:29.970294 tst handover.py: using BVCI 37299 00:30:30.084312 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:30:30.133380 tst handover.py: using LAC 37299 00:30:30.257387 tst handover.py: using RAC 69 00:30:30.386921 tst handover.py: using CellId 37299 00:30:30.509901 tst handover.py: using BVCI 37300 00:30:30.626343 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:30.637608 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:30.648597 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:30.659511 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:30.670898 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:30.682242 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:30:30.797933 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:30:30.946664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:31.434185 run create_hlr_db(pid=19173): Launched 00:30:31.579596 bus /sierra_2: Setting Powered False 00:30:32.638564 run create_hlr_db(pid=19173): Terminated: ok {rc=0} 00:30:33.025840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19175): Launched 00:30:33.319896 run osmo-hlr_10.42.42.2(pid=19176): Launched 00:30:33.432870 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:33.929898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19178): Launched 00:30:34.224885 run osmo-stp_10.42.42.5(pid=19179): Launched 00:30:34.337673 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:34.848733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19181): Launched 00:30:35.143768 run osmo-msc_10.42.42.6(pid=19182): Launched 00:30:35.308611 run osmo-stp_10.42.42.5(pid=19179): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19179)] 00:30:35.434329 run osmo-stp_10.42.42.5(pid=19179): stdout: | (launched: 2022-12-14_00:30:34.170569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:35.559573 run osmo-stp_10.42.42.5(pid=19179): stderr: | [0;m[38;5;43m20221214003034343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003034343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003034343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003034343 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003034344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003034344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003034344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:35.683231 run osmo-stp_10.42.42.5(pid=19179): stdout: | (launched: 2022-12-14_00:30:34.170569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:35.800544 run osmo-stp_10.42.42.5(pid=19179): stderr: | [0;m[38;5;43m20221214003034343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003034343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003034343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003034343 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003034344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003034344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003034344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:35.941354 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19179): Process ended prematurely: osmo-stp_10.42.42.5(pid=19179) [trial-2396↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19179)] [trial-2396↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 00:30:35.949348 tst handover.py:18: Test FAILED (6.4 sec) 00:30:35.974696 run osmo-hlr_10.42.42.2(pid=19176): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19176)] 00:30:36.021829 run osmo-hlr_10.42.42.2(pid=19176): stdout: | (launched: 2022-12-14_00:30:33.266436) 00:30:36.070452 run osmo-hlr_10.42.42.2(pid=19176): stderr: | [0;m[1;31m20221214003033439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003033439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003033439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003033439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003033439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003033439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003033450 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003033459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003033460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003033460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:36.138406 run osmo-msc_10.42.42.6(pid=19182): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19182)] 00:30:36.185308 run osmo-msc_10.42.42.6(pid=19182): stdout: | (launched: 2022-12-14_00:30:35.090185) 00:30:36.234320 run osmo-msc_10.42.42.6(pid=19182): stderr: | [0;m[38;5;43m20221214003035358 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003035358 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd0ea161c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003035358 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003035358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003035358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003035359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003035360 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003035361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003035361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003035361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:36.283221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19175): Terminating (SIGTERM) 00:30:36.322119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19178): Terminating (SIGTERM) 00:30:36.361048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19181): Terminating (SIGTERM) 00:30:36.400213 --- ParallelTerminationStrategy: PID 19175 died... 00:30:36.418859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19175): Terminated: ok {rc=0} 00:30:36.462299 --- ParallelTerminationStrategy: PID 19178 died... 00:30:36.480556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19178): Terminated: ok {rc=0} 00:30:36.523729 --- ParallelTerminationStrategy: PID 19181 died... 00:30:36.542040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19181): Terminated: ok {rc=0} 00:30:36.623911 bus /sierra_3: Setting Powered False 00:30:37.719784 bus /sierra_3: Setting Powered False 00:30:38.836270 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 00:30:40.086059 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:40.091259 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 00:30:40.136780 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:30:40.162907 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:30:40.213500 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 00:30:40.259738 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:30:40.285977 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:30:40.836232 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 00:30:40.841320 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:30:40.852147 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:30:40.886195 tst handover.py: using LAC 37300 00:30:41.011410 tst handover.py: using RAC 70 00:30:41.135091 tst handover.py: using CellId 37300 00:30:41.259378 tst handover.py: using BVCI 37301 00:30:41.375687 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:30:41.421309 tst handover.py: using LAC 37301 00:30:41.547022 tst handover.py: using RAC 71 00:30:41.672022 tst handover.py: using CellId 37301 00:30:41.797369 tst handover.py: using BVCI 37302 00:30:41.913899 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:30:41.925242 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:30:41.936299 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:30:41.947499 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:30:41.959576 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:30:41.971556 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:30:42.087493 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:30:42.206557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:42.669297 run create_hlr_db(pid=19187): Launched 00:30:42.790305 bus /sierra_2: Setting Powered False 00:30:43.852901 run create_hlr_db(pid=19187): Terminated: ok {rc=0} 00:30:44.265967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19189): Launched 00:30:44.581671 run osmo-hlr_10.42.42.2(pid=19190): Launched 00:30:44.702744 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:45.221200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19192): Launched 00:30:45.536762 run osmo-stp_10.42.42.5(pid=19193): Launched 00:30:45.658621 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:46.219037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19195): Launched 00:30:46.549646 run osmo-msc_10.42.42.6(pid=19196): Launched 00:30:46.890598 run osmo-stp_10.42.42.5(pid=19193): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19193)] 00:30:47.148788 run osmo-stp_10.42.42.5(pid=19193): stdout: | (launched: 2022-12-14_00:30:45.479613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:47.288445 run osmo-stp_10.42.42.5(pid=19193): stderr: | [0;m[38;5;43m20221214003045670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003045670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003045670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003045671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003045673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003045673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003045673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:47.420511 run osmo-stp_10.42.42.5(pid=19193): stdout: | (launched: 2022-12-14_00:30:45.479613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:47.547207 run osmo-stp_10.42.42.5(pid=19193): stderr: | [0;m[38;5;43m20221214003045670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003045670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003045670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003045671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003045673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003045673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003045673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:47.698368 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19193): Process ended prematurely: osmo-stp_10.42.42.5(pid=19193) [trial-2396↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19193)] [trial-2396↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 00:30:47.707017 tst handover.py:18: Test FAILED (6.9 sec) 00:30:47.733987 run osmo-hlr_10.42.42.2(pid=19190): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19190)] 00:30:47.783903 run osmo-hlr_10.42.42.2(pid=19190): stdout: | (launched: 2022-12-14_00:30:44.524751) 00:30:47.835172 run osmo-hlr_10.42.42.2(pid=19190): stderr: | [0;m[1;31m20221214003044721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003044721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003044721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003044721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003044721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003044721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003044733 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003044741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003044741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003044741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:47.907011 run osmo-msc_10.42.42.6(pid=19196): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19196)] 00:30:47.955923 run osmo-msc_10.42.42.6(pid=19196): stdout: | (launched: 2022-12-14_00:30:46.477566) 00:30:48.007392 run osmo-msc_10.42.42.6(pid=19196): stderr: | [0;m[38;5;43m20221214003047070 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003047070 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7febad62dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003047070 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003047070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003047070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003047070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003047072 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003047072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003047072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003047082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:48.059140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19189): Terminating (SIGTERM) 00:30:48.100199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19192): Terminating (SIGTERM) 00:30:48.141314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19195): Terminating (SIGTERM) 00:30:48.182733 --- ParallelTerminationStrategy: PID 19189 died... 00:30:48.202713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19189): Terminated: ok {rc=0} 00:30:48.248523 --- ParallelTerminationStrategy: PID 19192 died... 00:30:48.268144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19192): Terminated: ok {rc=0} 00:30:48.314262 --- ParallelTerminationStrategy: PID 19195 died... 00:30:48.333893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19195): Terminated: ok {rc=0} 00:30:48.420215 bus /sierra_3: Setting Powered False 00:30:49.517468 bus /sierra_3: Setting Powered False 00:30:50.633336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:30:51.891831 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:51.897809 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:30:51.955728 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:30:51.982571 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:30:52.035093 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:30:52.086364 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:30:52.112928 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:30:52.666048 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:30:52.672685 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:30:52.683839 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:30:52.717636 tst handover.py: using LAC 37302 00:30:52.835259 tst handover.py: using RAC 72 00:30:52.951798 tst handover.py: using CellId 37302 00:30:53.070775 tst handover.py: using BVCI 37303 00:30:53.179179 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:30:53.227806 tst handover.py: using LAC 37303 00:30:53.346569 tst handover.py: using RAC 73 00:30:53.462367 tst handover.py: using CellId 37303 00:30:53.580226 tst handover.py: using BVCI 37304 00:30:53.687632 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:30:53.698492 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:30:53.709070 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:30:53.719534 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:30:53.730317 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:30:53.740811 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:30:53.860444 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:30:53.975515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:54.408749 run create_hlr_db(pid=19204): Launched 00:30:54.529836 bus /sierra_2: Setting Powered False 00:30:55.588885 run create_hlr_db(pid=19204): Terminated: ok {rc=0} 00:30:55.977205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19206): Launched 00:30:56.271402 run osmo-hlr_10.42.42.2(pid=19207): Launched 00:30:56.383467 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:56.864250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19209): Launched 00:30:57.158504 run osmo-stp_10.42.42.5(pid=19210): Launched 00:30:57.270758 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:57.779375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19212): Launched 00:30:58.074258 run osmo-msc_10.42.42.6(pid=19213): Launched 00:30:58.239848 run osmo-stp_10.42.42.5(pid=19210): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19210)] 00:30:58.365553 run osmo-stp_10.42.42.5(pid=19210): stdout: | (launched: 2022-12-14_00:30:57.104801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:58.491760 run osmo-stp_10.42.42.5(pid=19210): stderr: | [0;m[38;5;43m20221214003057272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003057272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003057273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003057273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003057274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003057274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003057274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:58.615029 run osmo-stp_10.42.42.5(pid=19210): stdout: | (launched: 2022-12-14_00:30:57.104801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:58.732651 run osmo-stp_10.42.42.5(pid=19210): stderr: | [0;m[38;5;43m20221214003057272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003057272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003057273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003057273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003057274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003057274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003057274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:58.873497 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19210): Process ended prematurely: osmo-stp_10.42.42.5(pid=19210) [trial-2396↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19210)] [trial-2396↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 00:30:58.881341 tst handover.py:18: Test FAILED (6.2 sec) 00:30:58.906865 run osmo-hlr_10.42.42.2(pid=19207): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19207)] 00:30:58.953832 run osmo-hlr_10.42.42.2(pid=19207): stdout: | (launched: 2022-12-14_00:30:56.217965) 00:30:59.002835 run osmo-hlr_10.42.42.2(pid=19207): stderr: | [0;m[1;31m20221214003056395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003056395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003056395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003056395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003056395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003056395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003056408 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003056416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003056416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003056416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:59.070672 run osmo-msc_10.42.42.6(pid=19213): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19213)] 00:30:59.117972 run osmo-msc_10.42.42.6(pid=19213): stdout: | (launched: 2022-12-14_00:30:58.020427) 00:30:59.166674 run osmo-msc_10.42.42.6(pid=19213): stderr: | [0;m[38;5;43m20221214003058289 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003058289 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f98125edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003058289 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003058289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003058290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003058290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003058291 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003058292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003058292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003058292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:59.215721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19206): Terminating (SIGTERM) 00:30:59.255000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19209): Terminating (SIGTERM) 00:30:59.294239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19212): Terminating (SIGTERM) 00:30:59.333682 --- ParallelTerminationStrategy: PID 19206 died... 00:30:59.352375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19206): Terminated: ok {rc=0} 00:30:59.395888 --- ParallelTerminationStrategy: PID 19209 died... 00:30:59.414338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19209): Terminated: ok {rc=0} 00:30:59.457645 --- ParallelTerminationStrategy: PID 19212 died... 00:30:59.476019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19212): Terminated: ok {rc=0} 00:30:59.561800 bus /sierra_3: Setting Powered False 00:31:00.658665 bus /sierra_3: Setting Powered False 00:31:01.773062 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 00:31:03.032743 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:03.038013 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:31:03.077084 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:31:03.104348 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:31:03.157286 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:31:03.194757 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:31:03.221476 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:31:03.774775 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 00:31:03.780492 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:31:03.791697 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 00:31:03.832521 tst handover.py: using LAC 37304 00:31:03.948924 tst handover.py: using RAC 74 00:31:04.064017 tst handover.py: using CellId 37304 00:31:04.188890 tst handover.py: using BVCI 37305 00:31:04.306670 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 00:31:04.340107 tst handover.py: using LAC 37305 00:31:04.462389 tst handover.py: using RAC 75 00:31:04.586246 tst handover.py: using CellId 37305 00:31:04.705391 tst handover.py: using BVCI 37306 00:31:04.815251 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:31:04.826110 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:31:04.836657 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:31:04.847243 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:31:04.858008 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:31:04.868813 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 00:31:04.983871 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 00:31:05.097656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:05.531791 run create_hlr_db(pid=19218): Launched 00:31:05.653887 bus /sierra_2: Setting Powered False 00:31:06.713251 run create_hlr_db(pid=19218): Terminated: ok {rc=0} 00:31:07.120269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19220): Launched 00:31:07.436388 run osmo-hlr_10.42.42.2(pid=19221): Launched 00:31:07.559315 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:08.077167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19223): Launched 00:31:08.392550 run osmo-stp_10.42.42.5(pid=19224): Launched 00:31:08.513674 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:09.060248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19226): Launched 00:31:09.376710 run osmo-msc_10.42.42.6(pid=19227): Launched 00:31:09.555127 run osmo-stp_10.42.42.5(pid=19224): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19224)] 00:31:09.690495 run osmo-stp_10.42.42.5(pid=19224): stdout: | (launched: 2022-12-14_00:31:08.335665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:09.825679 run osmo-stp_10.42.42.5(pid=19224): stderr: | [0;m[38;5;43m20221214003108529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003108529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003108529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003108530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003108530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003108530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003108530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:09.960386 run osmo-stp_10.42.42.5(pid=19224): stdout: | (launched: 2022-12-14_00:31:08.335665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:10.087071 run osmo-stp_10.42.42.5(pid=19224): stderr: | [0;m[38;5;43m20221214003108529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003108529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003108529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003108530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003108530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003108530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003108530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:10.237983 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19224): Process ended prematurely: osmo-stp_10.42.42.5(pid=19224) [trial-2396↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19224)] [trial-2396↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 00:31:10.246714 tst handover.py:18: Test FAILED (6.5 sec) 00:31:10.273840 run osmo-hlr_10.42.42.2(pid=19221): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19221)] 00:31:10.324375 run osmo-hlr_10.42.42.2(pid=19221): stdout: | (launched: 2022-12-14_00:31:07.379250) 00:31:10.376150 run osmo-hlr_10.42.42.2(pid=19221): stderr: | [0;m[1;31m20221214003107576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003107576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003107576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003107576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003107577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003107577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003107589 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003107598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003107598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003107598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:10.448625 run osmo-msc_10.42.42.6(pid=19227): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19227)] 00:31:10.498524 run osmo-msc_10.42.42.6(pid=19227): stdout: | (launched: 2022-12-14_00:31:09.319122) 00:31:10.550437 run osmo-msc_10.42.42.6(pid=19227): stderr: | [0;m[38;5;43m20221214003109639 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003109640 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f40c394ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003109640 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003109640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003109640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003109640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003109642 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003109642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003109643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003109643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:10.602377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19220): Terminating (SIGTERM) 00:31:10.644571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19223): Terminating (SIGTERM) 00:31:10.687059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19226): Terminating (SIGTERM) 00:31:10.729672 --- ParallelTerminationStrategy: PID 19220 died... 00:31:10.749796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19220): Terminated: ok {rc=0} 00:31:10.796163 --- ParallelTerminationStrategy: PID 19223 died... 00:31:10.815930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19223): Terminated: ok {rc=0} 00:31:10.861967 --- ParallelTerminationStrategy: PID 19226 died... 00:31:10.881691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19226): Terminated: ok {rc=0} 00:31:10.968572 bus /sierra_3: Setting Powered False 00:31:12.067336 bus /sierra_3: Setting Powered False 00:31:13.184355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 00:31:14.426454 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:14.431902 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:31:14.483714 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:31:14.510664 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:31:14.562554 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:31:14.611794 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:31:14.637733 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:31:15.196393 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 00:31:15.202234 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:15.213724 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:31:15.248436 tst handover.py: using LAC 37306 00:31:15.373209 tst handover.py: using RAC 76 00:31:15.498168 tst handover.py: using CellId 37306 00:31:15.622103 tst handover.py: using BVCI 37307 00:31:15.740032 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:31:15.787543 tst handover.py: using LAC 37307 00:31:15.943120 tst handover.py: using RAC 77 00:31:16.070193 tst handover.py: using CellId 37307 00:31:16.195297 tst handover.py: using BVCI 37308 00:31:16.314460 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:16.326253 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:16.337887 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:16.349767 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:16.362349 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:16.374871 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:31:16.499210 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:31:16.619471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:17.126923 run create_hlr_db(pid=19232): Launched 00:31:17.258198 bus /sierra_2: Setting Powered False 00:31:18.317412 run create_hlr_db(pid=19232): Terminated: ok {rc=0} 00:31:18.707247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19234): Launched 00:31:19.002287 run osmo-hlr_10.42.42.2(pid=19235): Launched 00:31:19.114464 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:19.614012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19237): Launched 00:31:19.907409 run osmo-stp_10.42.42.5(pid=19238): Launched 00:31:20.019746 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:20.528109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19240): Launched 00:31:20.824025 run osmo-msc_10.42.42.6(pid=19241): Launched 00:31:20.992001 run osmo-stp_10.42.42.5(pid=19238): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19238)] 00:31:21.136418 run osmo-stp_10.42.42.5(pid=19238): stdout: | (launched: 2022-12-14_00:31:19.854020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:21.272249 run osmo-stp_10.42.42.5(pid=19238): stderr: | [0;m[38;5;43m20221214003120024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003120024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003120024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003120024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003120025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003120025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003120025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:21.407069 run osmo-stp_10.42.42.5(pid=19238): stdout: | (launched: 2022-12-14_00:31:19.854020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:21.534377 run osmo-stp_10.42.42.5(pid=19238): stderr: | [0;m[38;5;43m20221214003120024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003120024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003120024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003120024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003120025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003120025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003120025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:21.686794 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19238): Process ended prematurely: osmo-stp_10.42.42.5(pid=19238) [trial-2396↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19238)] [trial-2396↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 00:31:21.695693 tst handover.py:18: Test FAILED (6.5 sec) 00:31:21.723288 run osmo-hlr_10.42.42.2(pid=19235): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19235)] 00:31:21.774133 run osmo-hlr_10.42.42.2(pid=19235): stdout: | (launched: 2022-12-14_00:31:18.948864) 00:31:21.826091 run osmo-hlr_10.42.42.2(pid=19235): stderr: | [0;m[1;31m20221214003119125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003119126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003119126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003119126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003119126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003119126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003119138 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003119147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003119147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003119147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:21.899023 run osmo-msc_10.42.42.6(pid=19241): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19241)] 00:31:21.949434 run osmo-msc_10.42.42.6(pid=19241): stdout: | (launched: 2022-12-14_00:31:20.770106) 00:31:22.001719 run osmo-msc_10.42.42.6(pid=19241): stderr: | [0;m[38;5;43m20221214003121059 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003121059 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff6e6fdec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003121059 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003121059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003121059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003121060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003121061 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003121062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003121062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003121062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:22.054102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19234): Terminating (SIGTERM) 00:31:22.096089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19237): Terminating (SIGTERM) 00:31:22.138202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19240): Terminating (SIGTERM) 00:31:22.181068 --- ParallelTerminationStrategy: PID 19234 died... 00:31:22.201549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19234): Terminated: ok {rc=0} 00:31:22.248413 --- ParallelTerminationStrategy: PID 19237 died... 00:31:22.268569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19237): Terminated: ok {rc=0} 00:31:22.315309 --- ParallelTerminationStrategy: PID 19240 died... 00:31:22.335326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19240): Terminated: ok {rc=0} 00:31:22.423021 bus /sierra_3: Setting Powered False 00:31:23.518171 bus /sierra_3: Setting Powered False 00:31:24.632673 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 00:31:25.884261 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:25.889245 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:31:25.937964 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:31:25.964068 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:31:26.018438 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:31:26.067234 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:31:26.093292 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:31:26.638810 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 00:31:26.644130 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:26.654916 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:31:26.688802 tst handover.py: using LAC 37308 00:31:26.804404 tst handover.py: using RAC 78 00:31:26.919253 tst handover.py: using CellId 37308 00:31:27.043510 tst handover.py: using BVCI 37309 00:31:27.158404 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:31:27.205728 tst handover.py: using LAC 37309 00:31:27.321637 tst handover.py: using RAC 79 00:31:27.436503 tst handover.py: using CellId 37309 00:31:27.551324 tst handover.py: using BVCI 37310 00:31:27.658199 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:27.669082 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:27.679536 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:27.690075 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:27.700587 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:27.711097 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:31:27.824587 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:31:27.941859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:28.405502 run create_hlr_db(pid=19246): Launched 00:31:28.526752 bus /sierra_2: Setting Powered False 00:31:29.587021 run create_hlr_db(pid=19246): Terminated: ok {rc=0} 00:31:29.975816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19248): Launched 00:31:30.271994 run osmo-hlr_10.42.42.2(pid=19249): Launched 00:31:30.385081 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:30.879441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19251): Launched 00:31:31.263053 run osmo-stp_10.42.42.5(pid=19252): Launched 00:31:31.386207 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:32.090836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19254): Launched 00:31:32.427753 run osmo-msc_10.42.42.6(pid=19255): Launched 00:31:32.636718 run osmo-stp_10.42.42.5(pid=19252): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19252)] 00:31:32.772619 run osmo-stp_10.42.42.5(pid=19252): stdout: | (launched: 2022-12-14_00:31:31.200820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:32.907884 run osmo-stp_10.42.42.5(pid=19252): stderr: | [0;m[38;5;43m20221214003131620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003131620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003131620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003131621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003131621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003131621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003131621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:33.042215 run osmo-stp_10.42.42.5(pid=19252): stdout: | (launched: 2022-12-14_00:31:31.200820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:33.168293 run osmo-stp_10.42.42.5(pid=19252): stderr: | [0;m[38;5;43m20221214003131620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003131620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003131620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003131621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003131621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003131621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003131621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:33.318792 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19252): Process ended prematurely: osmo-stp_10.42.42.5(pid=19252) [trial-2396↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19252)] [trial-2396↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 00:31:33.327634 tst handover.py:18: Test FAILED (6.7 sec) 00:31:33.354602 run osmo-hlr_10.42.42.2(pid=19249): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19249)] 00:31:33.404646 run osmo-hlr_10.42.42.2(pid=19249): stdout: | (launched: 2022-12-14_00:31:30.218283) 00:31:33.455773 run osmo-hlr_10.42.42.2(pid=19249): stderr: | [0;m[1;31m20221214003130395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003130395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003130395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003130395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003130395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003130395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003130412 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003130421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003130421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003130421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:33.527913 run osmo-msc_10.42.42.6(pid=19255): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19255)] 00:31:33.577372 run osmo-msc_10.42.42.6(pid=19255): stdout: | (launched: 2022-12-14_00:31:32.366951) 00:31:33.628931 run osmo-msc_10.42.42.6(pid=19255): stderr: | [0;m[38;5;43m20221214003132735 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003132735 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4b88a20c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003132736 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003132736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003132736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003132736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003132738 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003132738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003132738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003132738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:33.681039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19248): Terminating (SIGTERM) 00:31:33.722094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19251): Terminating (SIGTERM) 00:31:33.763214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19254): Terminating (SIGTERM) 00:31:33.805254 --- ParallelTerminationStrategy: PID 19248 died... 00:31:33.824613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19248): Terminated: ok {rc=0} 00:31:33.870363 --- ParallelTerminationStrategy: PID 19251 died... 00:31:33.890464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19251): Terminated: ok {rc=0} 00:31:33.936021 --- ParallelTerminationStrategy: PID 19254 died... 00:31:33.955561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19254): Terminated: ok {rc=0} 00:31:34.042578 bus /sierra_3: Setting Powered False 00:31:35.139192 bus /sierra_3: Setting Powered False 00:31:36.253456 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 00:31:37.507624 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:37.513133 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 00:31:37.563224 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 00:31:37.590074 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 00:31:37.644789 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 00:31:37.695793 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 00:31:37.723006 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 00:31:38.269389 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 00:31:38.274876 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:31:38.286210 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:31:38.319310 tst handover.py: using LAC 37310 00:31:38.449116 tst handover.py: using RAC 80 00:31:38.572690 tst handover.py: using CellId 37310 00:31:38.695522 tst handover.py: using BVCI 37311 00:31:38.810740 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:31:38.857817 tst handover.py: using LAC 37311 00:31:38.981970 tst handover.py: using RAC 81 00:31:39.103764 tst handover.py: using CellId 37311 00:31:39.227233 tst handover.py: using BVCI 37312 00:31:39.341922 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:31:39.353061 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:31:39.364023 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:31:39.374920 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:31:39.386451 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:31:39.397697 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:31:39.513562 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:31:39.632092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:40.095461 run create_hlr_db(pid=19260): Launched 00:31:40.216004 bus /sierra_2: Setting Powered False 00:31:41.279352 run create_hlr_db(pid=19260): Terminated: ok {rc=0} 00:31:41.695359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19262): Launched 00:31:42.012482 run osmo-hlr_10.42.42.2(pid=19263): Launched 00:31:42.134024 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:42.651618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19265): Launched 00:31:42.967183 run osmo-stp_10.42.42.5(pid=19266): Launched 00:31:43.088128 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:43.634465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19268): Launched 00:31:43.951948 run osmo-msc_10.42.42.6(pid=19269): Launched 00:31:44.129870 run osmo-stp_10.42.42.5(pid=19266): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19266)] 00:31:44.264673 run osmo-stp_10.42.42.5(pid=19266): stdout: | (launched: 2022-12-14_00:31:42.910263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:44.400077 run osmo-stp_10.42.42.5(pid=19266): stderr: | [0;m[38;5;43m20221214003143102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003143102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003143103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003143103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003143103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003143103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003143103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:44.535102 run osmo-stp_10.42.42.5(pid=19266): stdout: | (launched: 2022-12-14_00:31:42.910263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:44.662187 run osmo-stp_10.42.42.5(pid=19266): stderr: | [0;m[38;5;43m20221214003143102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003143102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003143103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003143103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003143103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003143103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003143103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:44.813923 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19266): Process ended prematurely: osmo-stp_10.42.42.5(pid=19266) [trial-2396↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19266)] [trial-2396↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 00:31:44.822838 tst handover.py:18: Test FAILED (6.5 sec) 00:31:44.849858 run osmo-hlr_10.42.42.2(pid=19263): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19263)] 00:31:44.900267 run osmo-hlr_10.42.42.2(pid=19263): stdout: | (launched: 2022-12-14_00:31:41.955023) 00:31:44.951875 run osmo-hlr_10.42.42.2(pid=19263): stderr: | [0;m[1;31m20221214003142153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003142153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003142153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003142153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003142153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003142154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003142166 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003142174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003142174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003142175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:45.023816 run osmo-msc_10.42.42.6(pid=19269): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19269)] 00:31:45.072914 run osmo-msc_10.42.42.6(pid=19269): stdout: | (launched: 2022-12-14_00:31:43.894532) 00:31:45.124372 run osmo-msc_10.42.42.6(pid=19269): stderr: | [0;m[38;5;43m20221214003144215 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003144215 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6ec668ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003144215 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003144215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003144216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003144216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003144219 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003144220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003144220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003144220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:45.176292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19262): Terminating (SIGTERM) 00:31:45.218015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19265): Terminating (SIGTERM) 00:31:45.259757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19268): Terminating (SIGTERM) 00:31:45.301712 --- ParallelTerminationStrategy: PID 19262 died... 00:31:45.322200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19262): Terminated: ok {rc=0} 00:31:45.368538 --- ParallelTerminationStrategy: PID 19265 died... 00:31:45.388346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19265): Terminated: ok {rc=0} 00:31:45.434424 --- ParallelTerminationStrategy: PID 19268 died... 00:31:45.454458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19268): Terminated: ok {rc=0} 00:31:45.541363 bus /sierra_3: Setting Powered False 00:31:46.639078 bus /sierra_3: Setting Powered False 00:31:47.756673 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 00:31:49.008782 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:49.013679 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 00:31:49.057663 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:31:49.083635 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:31:49.134928 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 00:31:49.179016 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:31:49.204865 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:31:49.756421 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 00:31:49.762015 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:49.773148 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:31:49.806278 tst handover.py: using LAC 37312 00:31:49.923982 tst handover.py: using RAC 82 00:31:50.040862 tst handover.py: using CellId 37312 00:31:50.158606 tst handover.py: using BVCI 37313 00:31:50.268501 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:31:50.312484 tst handover.py: using LAC 37313 00:31:50.437815 tst handover.py: using RAC 83 00:31:50.552900 tst handover.py: using CellId 37313 00:31:50.668225 tst handover.py: using BVCI 37314 00:31:50.775589 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:50.786517 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:50.797561 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:50.808273 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:50.819089 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:50.830159 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:31:50.949647 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:31:51.062830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:51.495901 run create_hlr_db(pid=19274): Launched 00:31:51.617448 bus /sierra_2: Setting Powered False 00:31:52.677165 run create_hlr_db(pid=19274): Terminated: ok {rc=0} 00:31:53.084141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19276): Launched 00:31:53.383988 run osmo-hlr_10.42.42.2(pid=19277): Launched 00:31:53.495821 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:53.992226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19279): Launched 00:31:54.286007 run osmo-stp_10.42.42.5(pid=19280): Launched 00:31:54.398278 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:54.906468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19282): Launched 00:31:55.201561 run osmo-msc_10.42.42.6(pid=19283): Launched 00:31:55.366851 run osmo-stp_10.42.42.5(pid=19280): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19280)] 00:31:55.492059 run osmo-stp_10.42.42.5(pid=19280): stdout: | (launched: 2022-12-14_00:31:54.232312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:55.618142 run osmo-stp_10.42.42.5(pid=19280): stderr: | [0;m[38;5;43m20221214003154400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003154401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003154401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003154401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003154403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003154404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003154404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:55.741917 run osmo-stp_10.42.42.5(pid=19280): stdout: | (launched: 2022-12-14_00:31:54.232312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:55.859674 run osmo-stp_10.42.42.5(pid=19280): stderr: | [0;m[38;5;43m20221214003154400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003154401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003154401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003154401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003154403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003154404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003154404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:56.000559 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19280): Process ended prematurely: osmo-stp_10.42.42.5(pid=19280) [trial-2396↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19280)] [trial-2396↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 00:31:56.008850 tst handover.py:18: Test FAILED (6.2 sec) 00:31:56.034616 run osmo-hlr_10.42.42.2(pid=19277): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19277)] 00:31:56.082413 run osmo-hlr_10.42.42.2(pid=19277): stdout: | (launched: 2022-12-14_00:31:53.330106) 00:31:56.131484 run osmo-hlr_10.42.42.2(pid=19277): stderr: | [0;m[1;31m20221214003153504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003153504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003153504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003153504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003153504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003153504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003153516 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003153525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003153526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003153526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:56.199657 run osmo-msc_10.42.42.6(pid=19283): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19283)] 00:31:56.246816 run osmo-msc_10.42.42.6(pid=19283): stdout: | (launched: 2022-12-14_00:31:55.147357) 00:31:56.295652 run osmo-msc_10.42.42.6(pid=19283): stderr: | [0;m[38;5;43m20221214003155419 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003155419 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc72ed9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003155419 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003155419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003155420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003155420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003155422 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003155422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003155422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003155422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:56.344678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19276): Terminating (SIGTERM) 00:31:56.383888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19279): Terminating (SIGTERM) 00:31:56.423191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19282): Terminating (SIGTERM) 00:31:56.462730 --- ParallelTerminationStrategy: PID 19276 died... 00:31:56.481729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19276): Terminated: ok {rc=0} 00:31:56.525261 --- ParallelTerminationStrategy: PID 19279 died... 00:31:56.543698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19279): Terminated: ok {rc=0} 00:31:56.587314 --- ParallelTerminationStrategy: PID 19282 died... 00:31:56.605910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19282): Terminated: ok {rc=0} 00:31:56.691346 bus /sierra_3: Setting Powered False 00:31:57.787733 bus /sierra_3: Setting Powered False 00:31:58.899999 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:32:00.158652 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:00.164714 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:32:00.213691 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:32:00.239774 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:32:00.290506 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:32:00.340405 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:32:00.366691 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:32:00.925022 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:32:00.931782 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:00.944105 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:32:00.978980 tst handover.py: using LAC 37314 00:32:01.107716 tst handover.py: using RAC 84 00:32:01.257830 tst handover.py: using CellId 37314 00:32:01.376238 tst handover.py: using BVCI 37315 00:32:01.499823 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:32:01.550724 tst handover.py: using LAC 37315 00:32:01.705756 tst handover.py: using RAC 85 00:32:01.844782 tst handover.py: using CellId 37315 00:32:01.973476 tst handover.py: using BVCI 37316 00:32:02.095069 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:02.107415 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:02.120509 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:02.132753 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:02.145831 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:02.158846 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:32:02.283543 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:32:02.403651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:02.867719 run create_hlr_db(pid=19288): Launched 00:32:02.988286 bus /sierra_2: Setting Powered False 00:32:04.051048 run create_hlr_db(pid=19288): Terminated: ok {rc=0} 00:32:04.449594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19290): Launched 00:32:04.746219 run osmo-hlr_10.42.42.2(pid=19291): Launched 00:32:04.859163 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:05.362010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19293): Launched 00:32:05.657661 run osmo-stp_10.42.42.5(pid=19294): Launched 00:32:05.769608 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:06.279345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19296): Launched 00:32:06.574614 run osmo-msc_10.42.42.6(pid=19297): Launched 00:32:06.740717 run osmo-stp_10.42.42.5(pid=19294): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19294)] 00:32:06.866454 run osmo-stp_10.42.42.5(pid=19294): stdout: | (launched: 2022-12-14_00:32:05.603581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:06.993625 run osmo-stp_10.42.42.5(pid=19294): stderr: | [0;m[38;5;43m20221214003205774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003205774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003205775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003205775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003205775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003205776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003205776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:07.117530 run osmo-stp_10.42.42.5(pid=19294): stdout: | (launched: 2022-12-14_00:32:05.603581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:07.235320 run osmo-stp_10.42.42.5(pid=19294): stderr: | [0;m[38;5;43m20221214003205774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003205774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003205775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003205775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003205775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003205776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003205776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:07.376237 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19294): Process ended prematurely: osmo-stp_10.42.42.5(pid=19294) [trial-2396↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19294)] [trial-2396↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 00:32:07.384540 tst handover.py:18: Test FAILED (6.4 sec) 00:32:07.410459 run osmo-hlr_10.42.42.2(pid=19291): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19291)] 00:32:07.458456 run osmo-hlr_10.42.42.2(pid=19291): stdout: | (launched: 2022-12-14_00:32:04.692292) 00:32:07.507996 run osmo-hlr_10.42.42.2(pid=19291): stderr: | [0;m[1;31m20221214003204866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003204866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003204866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003204866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003204866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003204866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003204878 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003204886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003204887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003204887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:07.577022 run osmo-msc_10.42.42.6(pid=19297): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19297)] 00:32:07.624529 run osmo-msc_10.42.42.6(pid=19297): stdout: | (launched: 2022-12-14_00:32:06.520528) 00:32:07.673636 run osmo-msc_10.42.42.6(pid=19297): stderr: | [0;m[38;5;43m20221214003206793 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003206793 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f46a9272c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003206794 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003206794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003206794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003206794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003206796 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003206796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003206796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003206796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:07.723096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19290): Terminating (SIGTERM) 00:32:07.762607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19293): Terminating (SIGTERM) 00:32:07.802089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19296): Terminating (SIGTERM) 00:32:07.841901 --- ParallelTerminationStrategy: PID 19290 died... 00:32:07.861108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19290): Terminated: ok {rc=0} 00:32:07.905076 --- ParallelTerminationStrategy: PID 19293 died... 00:32:07.923850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19293): Terminated: ok {rc=0} 00:32:07.967516 --- ParallelTerminationStrategy: PID 19296 died... 00:32:07.986424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19296): Terminated: ok {rc=0} 00:32:08.071470 bus /sierra_3: Setting Powered False 00:32:09.169990 bus /sierra_3: Setting Powered False 00:32:10.285300 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 00:32:11.549683 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:11.555101 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:32:11.592877 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:32:11.620511 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:32:11.671807 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:32:11.709335 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:32:11.736237 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:32:12.288475 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 00:32:12.294161 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:12.305193 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 00:32:12.338448 tst handover.py: using LAC 37316 00:32:12.462103 tst handover.py: using RAC 86 00:32:12.587370 tst handover.py: using CellId 37316 00:32:12.711323 tst handover.py: using BVCI 37317 00:32:12.820844 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 00:32:12.854350 tst handover.py: using LAC 37317 00:32:12.970677 tst handover.py: using RAC 87 00:32:13.086692 tst handover.py: using CellId 37317 00:32:13.202725 tst handover.py: using BVCI 37318 00:32:13.311868 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:13.322516 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:13.332874 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:13.343420 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:13.354383 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:13.365853 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 00:32:13.481189 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 00:32:13.598255 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:14.062419 run create_hlr_db(pid=19302): Launched 00:32:14.183927 bus /sierra_2: Setting Powered False 00:32:15.247430 run create_hlr_db(pid=19302): Terminated: ok {rc=0} 00:32:15.649189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19304): Launched 00:32:15.983533 run osmo-hlr_10.42.42.2(pid=19305): Launched 00:32:16.134125 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:16.814908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19307): Launched 00:32:17.148654 run osmo-stp_10.42.42.5(pid=19308): Launched 00:32:17.309942 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:17.823867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19310): Launched 00:32:18.118567 run osmo-msc_10.42.42.6(pid=19311): Launched 00:32:18.283123 run osmo-stp_10.42.42.5(pid=19308): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19308)] 00:32:18.409083 run osmo-stp_10.42.42.5(pid=19308): stdout: | (launched: 2022-12-14_00:32:17.081637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:18.534409 run osmo-stp_10.42.42.5(pid=19308): stderr: | [0;m[38;5;43m20221214003217298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003217299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003217299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003217299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003217300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003217300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003217300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:18.657962 run osmo-stp_10.42.42.5(pid=19308): stdout: | (launched: 2022-12-14_00:32:17.081637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:18.775232 run osmo-stp_10.42.42.5(pid=19308): stderr: | [0;m[38;5;43m20221214003217298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003217299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003217299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003217299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003217300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003217300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003217300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:18.915937 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19308): Process ended prematurely: osmo-stp_10.42.42.5(pid=19308) [trial-2396↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19308)] [trial-2396↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 00:32:18.923978 tst handover.py:18: Test FAILED (6.6 sec) 00:32:18.949383 run osmo-hlr_10.42.42.2(pid=19305): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19305)] 00:32:18.996252 run osmo-hlr_10.42.42.2(pid=19305): stdout: | (launched: 2022-12-14_00:32:15.909386) 00:32:19.045544 run osmo-hlr_10.42.42.2(pid=19305): stderr: | [0;m[1;31m20221214003216256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003216270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003216270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003216270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003216270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003216270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003216290 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003216304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003216304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003216304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:19.113363 run osmo-msc_10.42.42.6(pid=19311): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19311)] 00:32:19.159970 run osmo-msc_10.42.42.6(pid=19311): stdout: | (launched: 2022-12-14_00:32:18.064747) 00:32:19.208260 run osmo-msc_10.42.42.6(pid=19311): stderr: | [0;m[38;5;43m20221214003218335 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003218335 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3820db6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003218335 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003218335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003218336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003218336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003218338 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003218338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003218338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003218338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:19.256773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19304): Terminating (SIGTERM) 00:32:19.295669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19307): Terminating (SIGTERM) 00:32:19.334636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19310): Terminating (SIGTERM) 00:32:19.374375 --- ParallelTerminationStrategy: PID 19304 died... 00:32:19.393349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19304): Terminated: ok {rc=0} 00:32:19.437049 --- ParallelTerminationStrategy: PID 19307 died... 00:32:19.455466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19307): Terminated: ok {rc=0} 00:32:19.498864 --- ParallelTerminationStrategy: PID 19310 died... 00:32:19.517420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19310): Terminated: ok {rc=0} 00:32:19.600404 bus /sierra_3: Setting Powered False 00:32:20.698139 bus /sierra_3: Setting Powered False 00:32:21.814585 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 00:32:23.056735 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:23.062318 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:32:23.113495 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:32:23.140498 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:32:23.192873 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:32:23.241902 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:32:23.268143 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:32:23.821305 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 00:32:23.827642 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:23.839435 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:32:23.873729 tst handover.py: using LAC 37318 00:32:23.999033 tst handover.py: using RAC 88 00:32:24.127318 tst handover.py: using CellId 37318 00:32:24.251837 tst handover.py: using BVCI 37319 00:32:24.367139 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:32:24.417185 tst handover.py: using LAC 37319 00:32:24.541728 tst handover.py: using RAC 89 00:32:24.665397 tst handover.py: using CellId 37319 00:32:24.783139 tst handover.py: using BVCI 37320 00:32:24.891636 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:24.902501 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:24.913222 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:24.923846 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:24.934616 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:24.945058 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:32:25.060579 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:32:25.175468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:25.610701 run create_hlr_db(pid=19316): Launched 00:32:25.732424 bus /sierra_2: Setting Powered False 00:32:26.791746 run create_hlr_db(pid=19316): Terminated: ok {rc=0} 00:32:27.199502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19318): Launched 00:32:27.515827 run osmo-hlr_10.42.42.2(pid=19319): Launched 00:32:27.637217 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:28.157113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19321): Launched 00:32:28.471767 run osmo-stp_10.42.42.5(pid=19322): Launched 00:32:28.592814 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:29.136259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19324): Launched 00:32:29.452666 run osmo-msc_10.42.42.6(pid=19325): Launched 00:32:29.630635 run osmo-stp_10.42.42.5(pid=19322): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19322)] 00:32:29.765787 run osmo-stp_10.42.42.5(pid=19322): stdout: | (launched: 2022-12-14_00:32:28.414600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:29.900593 run osmo-stp_10.42.42.5(pid=19322): stderr: | [0;m[38;5;43m20221214003228605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003228605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003228605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003228606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003228608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003228608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003228608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:30.034508 run osmo-stp_10.42.42.5(pid=19322): stdout: | (launched: 2022-12-14_00:32:28.414600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:30.160576 run osmo-stp_10.42.42.5(pid=19322): stderr: | [0;m[38;5;43m20221214003228605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003228605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003228605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003228606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003228608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003228608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003228608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:30.311526 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19322): Process ended prematurely: osmo-stp_10.42.42.5(pid=19322) [trial-2396↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19322)] [trial-2396↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 00:32:30.320439 tst handover.py:18: Test FAILED (6.5 sec) 00:32:30.347530 run osmo-hlr_10.42.42.2(pid=19319): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19319)] 00:32:30.397492 run osmo-hlr_10.42.42.2(pid=19319): stdout: | (launched: 2022-12-14_00:32:27.458366) 00:32:30.448807 run osmo-hlr_10.42.42.2(pid=19319): stderr: | [0;m[1;31m20221214003227654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003227654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003227654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003227654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003227654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003227654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003227666 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003227674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003227674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003227674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:30.520378 run osmo-msc_10.42.42.6(pid=19325): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19325)] 00:32:30.569853 run osmo-msc_10.42.42.6(pid=19325): stdout: | (launched: 2022-12-14_00:32:29.395464) 00:32:30.621250 run osmo-msc_10.42.42.6(pid=19325): stderr: | [0;m[38;5;43m20221214003229715 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003229715 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f474222fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003229716 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003229716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003229716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003229716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003229718 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003229718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003229718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003229718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:30.673403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19318): Terminating (SIGTERM) 00:32:30.714936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19321): Terminating (SIGTERM) 00:32:30.756427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19324): Terminating (SIGTERM) 00:32:30.798580 --- ParallelTerminationStrategy: PID 19318 died... 00:32:30.818771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19318): Terminated: ok {rc=0} 00:32:30.875507 --- ParallelTerminationStrategy: PID 19321 died... 00:32:30.897506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19321): Terminated: ok {rc=0} 00:32:30.949927 --- ParallelTerminationStrategy: PID 19324 died... 00:32:30.970548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19324): Terminated: ok {rc=0} 00:32:31.064638 bus /sierra_3: Setting Powered False 00:32:32.166545 bus /sierra_3: Setting Powered False 00:32:33.296853 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 00:32:34.551152 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:34.556022 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:32:34.603765 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:32:34.630037 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:32:34.685336 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:32:34.732562 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:32:34.758686 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:32:35.306234 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 00:32:35.311659 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:35.322395 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:32:35.355580 tst handover.py: using LAC 37320 00:32:35.470723 tst handover.py: using RAC 90 00:32:35.585373 tst handover.py: using CellId 37320 00:32:35.700371 tst handover.py: using BVCI 37321 00:32:35.807311 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:32:35.853418 tst handover.py: using LAC 37321 00:32:35.977051 tst handover.py: using RAC 91 00:32:36.099721 tst handover.py: using CellId 37321 00:32:36.216417 tst handover.py: using BVCI 37322 00:32:36.323427 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:36.334328 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:36.345160 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:36.355819 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:36.366789 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:36.377703 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:32:36.496684 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:32:36.613939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:37.047882 run create_hlr_db(pid=19330): Launched 00:32:37.169577 bus /sierra_2: Setting Powered False 00:32:38.229139 run create_hlr_db(pid=19330): Terminated: ok {rc=0} 00:32:38.636626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19332): Launched 00:32:38.954323 run osmo-hlr_10.42.42.2(pid=19333): Launched 00:32:39.075508 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:39.596677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19335): Launched 00:32:39.912893 run osmo-stp_10.42.42.5(pid=19336): Launched 00:32:40.027373 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:40.541785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19338): Launched 00:32:40.838180 run osmo-msc_10.42.42.6(pid=19339): Launched 00:32:41.003034 run osmo-stp_10.42.42.5(pid=19336): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19336)] 00:32:41.129100 run osmo-stp_10.42.42.5(pid=19336): stdout: | (launched: 2022-12-14_00:32:39.856003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:41.255791 run osmo-stp_10.42.42.5(pid=19336): stderr: | [0;m[38;5;43m20221214003240028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003240028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003240028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003240029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003240029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003240029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003240029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:41.379631 run osmo-stp_10.42.42.5(pid=19336): stdout: | (launched: 2022-12-14_00:32:39.856003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:41.497395 run osmo-stp_10.42.42.5(pid=19336): stderr: | [0;m[38;5;43m20221214003240028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003240028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003240028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003240029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003240029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003240029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003240029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:41.638266 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19336): Process ended prematurely: osmo-stp_10.42.42.5(pid=19336) [trial-2396↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19336)] [trial-2396↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 00:32:41.646474 tst handover.py:18: Test FAILED (6.3 sec) 00:32:41.672245 run osmo-hlr_10.42.42.2(pid=19333): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19333)] 00:32:41.719205 run osmo-hlr_10.42.42.2(pid=19333): stdout: | (launched: 2022-12-14_00:32:38.897118) 00:32:41.768504 run osmo-hlr_10.42.42.2(pid=19333): stderr: | [0;m[1;31m20221214003239093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003239093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003239093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003239093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003239093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003239094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003239106 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003239115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003239115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003239115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:41.836332 run osmo-msc_10.42.42.6(pid=19339): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19339)] 00:32:41.883533 run osmo-msc_10.42.42.6(pid=19339): stdout: | (launched: 2022-12-14_00:32:40.784011) 00:32:41.932268 run osmo-msc_10.42.42.6(pid=19339): stderr: | [0;m[38;5;43m20221214003241053 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003241053 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f145ebc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003241053 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003241053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003241053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003241053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003241055 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003241055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003241056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003241056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:41.981376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19332): Terminating (SIGTERM) 00:32:42.020565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19335): Terminating (SIGTERM) 00:32:42.059677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19338): Terminating (SIGTERM) 00:32:42.098994 --- ParallelTerminationStrategy: PID 19332 died... 00:32:42.118016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19332): Terminated: ok {rc=0} 00:32:42.161474 --- ParallelTerminationStrategy: PID 19335 died... 00:32:42.179730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19335): Terminated: ok {rc=0} 00:32:42.223132 --- ParallelTerminationStrategy: PID 19338 died... 00:32:42.241808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19338): Terminated: ok {rc=0} 00:32:42.327142 bus /sierra_3: Setting Powered False 00:32:43.425425 bus /sierra_3: Setting Powered False 00:32:44.539852 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 00:32:45.790749 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:45.795742 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 00:32:45.859920 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:32:45.897212 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:32:45.970147 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 00:32:46.043380 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:32:46.071926 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:32:46.633731 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 00:32:46.641520 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:46.655898 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:32:46.713735 tst handover.py: using LAC 37322 00:32:46.869585 tst handover.py: using RAC 92 00:32:46.994124 tst handover.py: using CellId 37322 00:32:47.113600 tst handover.py: using BVCI 37323 00:32:47.255774 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:32:47.303222 tst handover.py: using LAC 37323 00:32:47.434904 tst handover.py: using RAC 93 00:32:47.558060 tst handover.py: using CellId 37323 00:32:47.680097 tst handover.py: using BVCI 37324 00:32:47.794817 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:47.806394 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:47.817780 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:47.829261 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:47.840878 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:47.852280 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:32:47.967506 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:32:48.085508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:48.522904 run create_hlr_db(pid=19344): Launched 00:32:48.645123 bus /sierra_2: Setting Powered False 00:32:49.705117 run create_hlr_db(pid=19344): Terminated: ok {rc=0} 00:32:50.110176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19346): Launched 00:32:50.425782 run osmo-hlr_10.42.42.2(pid=19347): Launched 00:32:50.546695 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:51.064729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19349): Launched 00:32:51.381004 run osmo-stp_10.42.42.5(pid=19350): Launched 00:32:51.502486 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:52.048700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19352): Launched 00:32:52.364503 run osmo-msc_10.42.42.6(pid=19353): Launched 00:32:52.541773 run osmo-stp_10.42.42.5(pid=19350): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19350)] 00:32:52.676194 run osmo-stp_10.42.42.5(pid=19350): stdout: | (launched: 2022-12-14_00:32:51.323859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:52.811450 run osmo-stp_10.42.42.5(pid=19350): stderr: | [0;m[38;5;43m20221214003251515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003251515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003251515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003251515 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003251518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003251518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003251518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:52.945729 run osmo-stp_10.42.42.5(pid=19350): stdout: | (launched: 2022-12-14_00:32:51.323859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:53.072039 run osmo-stp_10.42.42.5(pid=19350): stderr: | [0;m[38;5;43m20221214003251515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003251515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003251515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003251515 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003251518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003251518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003251518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:53.223165 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19350): Process ended prematurely: osmo-stp_10.42.42.5(pid=19350) [trial-2396↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19350)] [trial-2396↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 00:32:53.232039 tst handover.py:18: Test FAILED (6.6 sec) 00:32:53.259129 run osmo-hlr_10.42.42.2(pid=19347): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19347)] 00:32:53.309815 run osmo-hlr_10.42.42.2(pid=19347): stdout: | (launched: 2022-12-14_00:32:50.368671) 00:32:53.361466 run osmo-hlr_10.42.42.2(pid=19347): stderr: | [0;m[1;31m20221214003250565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003250565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003250565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003250565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003250565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003250565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003250577 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003250585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003250585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003250585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:53.433781 run osmo-msc_10.42.42.6(pid=19353): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19353)] 00:32:53.483236 run osmo-msc_10.42.42.6(pid=19353): stdout: | (launched: 2022-12-14_00:32:52.307583) 00:32:53.534972 run osmo-msc_10.42.42.6(pid=19353): stderr: | [0;m[38;5;43m20221214003252627 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003252628 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f15fc1e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003252628 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003252628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003252628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003252628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003252630 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003252630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003252630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003252631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:53.587252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19346): Terminating (SIGTERM) 00:32:53.628703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19349): Terminating (SIGTERM) 00:32:53.670580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19352): Terminating (SIGTERM) 00:32:53.712861 --- ParallelTerminationStrategy: PID 19346 died... 00:32:53.733316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19346): Terminated: ok {rc=0} 00:32:53.779618 --- ParallelTerminationStrategy: PID 19349 died... 00:32:53.799488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19349): Terminated: ok {rc=0} 00:32:53.845468 --- ParallelTerminationStrategy: PID 19352 died... 00:32:53.865294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19352): Terminated: ok {rc=0} 00:32:53.952402 bus /sierra_3: Setting Powered False 00:32:55.050233 bus /sierra_3: Setting Powered False 00:32:56.166346 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:32:57.431647 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:57.436656 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:32:57.498705 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:32:57.525032 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:32:57.575127 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:32:57.638018 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:32:57.664661 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:32:58.215372 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:32:58.220552 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:58.231519 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:32:58.282669 tst handover.py: using LAC 37324 00:32:58.398233 tst handover.py: using RAC 94 00:32:58.517147 tst handover.py: using CellId 37324 00:32:58.642281 tst handover.py: using BVCI 37325 00:32:58.758254 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:32:58.806608 tst handover.py: using LAC 37325 00:32:58.930770 tst handover.py: using RAC 95 00:32:59.052842 tst handover.py: using CellId 37325 00:32:59.176021 tst handover.py: using BVCI 37326 00:32:59.284369 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:59.295442 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:59.306415 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:59.317501 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:59.328248 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:59.339396 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:32:59.458804 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:32:59.575345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:00.009760 run create_hlr_db(pid=19358): Launched 00:33:00.130838 bus /sierra_2: Setting Powered False 00:33:01.206133 run create_hlr_db(pid=19358): Terminated: ok {rc=0} 00:33:01.721130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19361): Launched 00:33:02.143110 run osmo-hlr_10.42.42.2(pid=19362): Launched 00:33:02.347913 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:02.902329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19364): Launched 00:33:03.219590 run osmo-stp_10.42.42.5(pid=19365): Launched 00:33:03.340808 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:03.886899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19367): Launched 00:33:04.204244 run osmo-msc_10.42.42.6(pid=19368): Launched 00:33:04.382581 run osmo-stp_10.42.42.5(pid=19365): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19365)] 00:33:04.517324 run osmo-stp_10.42.42.5(pid=19365): stdout: | (launched: 2022-12-14_00:33:03.162343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:04.652736 run osmo-stp_10.42.42.5(pid=19365): stderr: | [0;m[38;5;43m20221214003303355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003303355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003303356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003303356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003303356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003303357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003303357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:04.787713 run osmo-stp_10.42.42.5(pid=19365): stdout: | (launched: 2022-12-14_00:33:03.162343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:04.914544 run osmo-stp_10.42.42.5(pid=19365): stderr: | [0;m[38;5;43m20221214003303355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003303355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003303356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003303356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003303356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003303357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003303357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:05.065972 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19365): Process ended prematurely: osmo-stp_10.42.42.5(pid=19365) [trial-2396↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19365)] [trial-2396↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 00:33:05.074734 tst handover.py:18: Test FAILED (6.8 sec) 00:33:05.101715 run osmo-hlr_10.42.42.2(pid=19362): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19362)] 00:33:05.152154 run osmo-hlr_10.42.42.2(pid=19362): stdout: | (launched: 2022-12-14_00:33:02.084457) 00:33:05.204201 run osmo-hlr_10.42.42.2(pid=19362): stderr: | [0;m[1;31m20221214003302361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003302361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003302361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003302361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003302361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003302361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003302373 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003302382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003302382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003302382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:05.276325 run osmo-msc_10.42.42.6(pid=19368): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19368)] 00:33:05.325926 run osmo-msc_10.42.42.6(pid=19368): stdout: | (launched: 2022-12-14_00:33:04.146795) 00:33:05.377659 run osmo-msc_10.42.42.6(pid=19368): stderr: | [0;m[38;5;43m20221214003304466 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003304466 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f99fac61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003304466 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003304466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003304466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003304467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003304468 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003304469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003304469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003304469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:05.430092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19361): Terminating (SIGTERM) 00:33:05.471798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19364): Terminating (SIGTERM) 00:33:05.514088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19367): Terminating (SIGTERM) 00:33:05.556614 --- ParallelTerminationStrategy: PID 19361 died... 00:33:05.577025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19361): Terminated: ok {rc=0} 00:33:05.623206 --- ParallelTerminationStrategy: PID 19364 died... 00:33:05.643051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19364): Terminated: ok {rc=0} 00:33:05.689454 --- ParallelTerminationStrategy: PID 19367 died... 00:33:05.709069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19367): Terminated: ok {rc=0} 00:33:05.796937 bus /sierra_3: Setting Powered False 00:33:06.894750 bus /sierra_3: Setting Powered False 00:33:08.010549 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 00:33:09.280419 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:09.286775 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:33:09.339166 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:33:09.366373 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:33:09.419896 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:33:09.472328 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:33:09.499852 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:33:10.045012 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 00:33:10.050315 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:10.061227 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 00:33:10.107961 tst handover.py: using LAC 37326 00:33:10.233852 tst handover.py: using RAC 96 00:33:10.357714 tst handover.py: using CellId 37326 00:33:10.474728 tst handover.py: using BVCI 37327 00:33:10.583945 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 00:33:10.618711 tst handover.py: using LAC 37327 00:33:10.737135 tst handover.py: using RAC 97 00:33:10.853383 tst handover.py: using CellId 37327 00:33:10.970274 tst handover.py: using BVCI 37328 00:33:11.079343 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:11.090093 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:11.100633 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:11.111137 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:11.121748 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:11.132710 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 00:33:11.252173 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 00:33:11.367567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:11.803538 run create_hlr_db(pid=19373): Launched 00:33:11.924791 bus /sierra_2: Setting Powered False 00:33:12.984535 run create_hlr_db(pid=19373): Terminated: ok {rc=0} 00:33:13.374575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19375): Launched 00:33:13.671173 run osmo-hlr_10.42.42.2(pid=19376): Launched 00:33:13.783765 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:14.284516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19378): Launched 00:33:14.581545 run osmo-stp_10.42.42.5(pid=19379): Launched 00:33:14.694891 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:15.208058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19381): Launched 00:33:15.505397 run osmo-msc_10.42.42.6(pid=19382): Launched 00:33:15.672071 run osmo-stp_10.42.42.5(pid=19379): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19379)] 00:33:15.797951 run osmo-stp_10.42.42.5(pid=19379): stdout: | (launched: 2022-12-14_00:33:14.527423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:15.960033 run osmo-stp_10.42.42.5(pid=19379): stderr: | [0;m[38;5;43m20221214003314696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003314697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003314697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003314697 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003314699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003314700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003314700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:16.086341 run osmo-stp_10.42.42.5(pid=19379): stdout: | (launched: 2022-12-14_00:33:14.527423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:16.207428 run osmo-stp_10.42.42.5(pid=19379): stderr: | [0;m[38;5;43m20221214003314696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003314697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003314697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003314697 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003314699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003314700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003314700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:16.352712 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19379): Process ended prematurely: osmo-stp_10.42.42.5(pid=19379) [trial-2396↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19379)] [trial-2396↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 00:33:16.361911 tst handover.py:18: Test FAILED (6.3 sec) 00:33:16.388821 run osmo-hlr_10.42.42.2(pid=19376): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19376)] 00:33:16.438645 run osmo-hlr_10.42.42.2(pid=19376): stdout: | (launched: 2022-12-14_00:33:13.617311) 00:33:16.489116 run osmo-hlr_10.42.42.2(pid=19376): stderr: | [0;m[1;31m20221214003313792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003313792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003313792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003313792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003313792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003313792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003313804 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003313813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003313813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003313813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:16.560184 run osmo-msc_10.42.42.6(pid=19382): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19382)] 00:33:16.609333 run osmo-msc_10.42.42.6(pid=19382): stdout: | (launched: 2022-12-14_00:33:15.450693) 00:33:16.659648 run osmo-msc_10.42.42.6(pid=19382): stderr: | [0;m[38;5;43m20221214003315723 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003315723 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5ad3676c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003315724 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003315724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003315724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003315724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003315727 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003315728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003315728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003315728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:16.709820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19375): Terminating (SIGTERM) 00:33:16.753529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19378): Terminating (SIGTERM) 00:33:16.795351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19381): Terminating (SIGTERM) 00:33:16.838144 --- ParallelTerminationStrategy: PID 19375 died... 00:33:16.858663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19375): Terminated: ok {rc=0} 00:33:16.904367 --- ParallelTerminationStrategy: PID 19378 died... 00:33:16.924640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19378): Terminated: ok {rc=0} 00:33:16.970436 --- ParallelTerminationStrategy: PID 19381 died... 00:33:16.990639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19381): Terminated: ok {rc=0} 00:33:17.076516 bus /sierra_3: Setting Powered False 00:33:18.171960 bus /sierra_3: Setting Powered False 00:33:19.286787 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 00:33:20.539054 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:20.544046 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:33:20.605312 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:33:20.631895 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:33:20.683871 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:33:20.747004 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:33:20.773372 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:33:21.320235 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 00:33:21.325578 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:21.336197 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:33:21.383323 tst handover.py: using LAC 37328 00:33:21.507254 tst handover.py: using RAC 98 00:33:21.632700 tst handover.py: using CellId 37328 00:33:21.757440 tst handover.py: using BVCI 37329 00:33:21.874357 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:33:21.923049 tst handover.py: using LAC 37329 00:33:22.048813 tst handover.py: using RAC 99 00:33:22.165349 tst handover.py: using CellId 37329 00:33:22.281799 tst handover.py: using BVCI 37330 00:33:22.390513 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:22.401359 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:22.411835 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:22.422407 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:22.432846 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:22.443800 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:33:22.564337 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:33:22.679102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:23.113543 run create_hlr_db(pid=19387): Launched 00:33:23.234098 bus /sierra_2: Setting Powered False 00:33:24.293559 run create_hlr_db(pid=19387): Terminated: ok {rc=0} 00:33:24.702193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19389): Launched 00:33:25.020094 run osmo-hlr_10.42.42.2(pid=19390): Launched 00:33:25.141776 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:25.660162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19392): Launched 00:33:25.977909 run osmo-stp_10.42.42.5(pid=19393): Launched 00:33:26.099405 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:26.649543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19395): Launched 00:33:26.968568 run osmo-msc_10.42.42.6(pid=19396): Launched 00:33:27.147137 run osmo-stp_10.42.42.5(pid=19393): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19393)] 00:33:27.283094 run osmo-stp_10.42.42.5(pid=19393): stdout: | (launched: 2022-12-14_00:33:25.920485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:27.419657 run osmo-stp_10.42.42.5(pid=19393): stderr: | [0;m[38;5;43m20221214003326109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003326109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003326109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003326109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003326112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003326112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003326112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:27.555213 run osmo-stp_10.42.42.5(pid=19393): stdout: | (launched: 2022-12-14_00:33:25.920485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:27.682798 run osmo-stp_10.42.42.5(pid=19393): stderr: | [0;m[38;5;43m20221214003326109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003326109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003326109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003326109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003326112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003326112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003326112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:27.835659 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19393): Process ended prematurely: osmo-stp_10.42.42.5(pid=19393) [trial-2396↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19393)] [trial-2396↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 00:33:27.844566 tst handover.py:18: Test FAILED (6.5 sec) 00:33:27.871824 run osmo-hlr_10.42.42.2(pid=19390): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19390)] 00:33:27.922567 run osmo-hlr_10.42.42.2(pid=19390): stdout: | (launched: 2022-12-14_00:33:24.962572) 00:33:27.974663 run osmo-hlr_10.42.42.2(pid=19390): stderr: | [0;m[1;31m20221214003325161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003325161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003325161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003325161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003325162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003325162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003325177 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003325187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003325187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003325187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:28.047526 run osmo-msc_10.42.42.6(pid=19396): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19396)] 00:33:28.096924 run osmo-msc_10.42.42.6(pid=19396): stdout: | (launched: 2022-12-14_00:33:26.910682) 00:33:28.148495 run osmo-msc_10.42.42.6(pid=19396): stderr: | [0;m[38;5;43m20221214003327230 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003327230 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f47c4689c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003327230 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003327230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003327231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003327231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003327234 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003327235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003327235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003327235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:28.200854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19389): Terminating (SIGTERM) 00:33:28.242645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19392): Terminating (SIGTERM) 00:33:28.284184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19395): Terminating (SIGTERM) 00:33:28.326239 --- ParallelTerminationStrategy: PID 19389 died... 00:33:28.346730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19389): Terminated: ok {rc=0} 00:33:28.393239 --- ParallelTerminationStrategy: PID 19392 died... 00:33:28.413284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19392): Terminated: ok {rc=0} 00:33:28.459427 --- ParallelTerminationStrategy: PID 19395 died... 00:33:28.479483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19395): Terminated: ok {rc=0} 00:33:28.567302 bus /sierra_3: Setting Powered False 00:33:29.664477 bus /sierra_3: Setting Powered False 00:33:30.781357 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 00:33:32.075100 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:32.080923 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:33:32.158661 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:33:32.189577 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:33:32.245063 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:33:32.307824 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:33:32.335826 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:33:32.886028 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 00:33:32.891309 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:32.902327 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:33:32.950040 tst handover.py: using LAC 37330 00:33:33.066458 tst handover.py: using RAC 100 00:33:33.185532 tst handover.py: using CellId 37330 00:33:33.303567 tst handover.py: using BVCI 37331 00:33:33.421657 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:33:33.471537 tst handover.py: using LAC 37331 00:33:33.596454 tst handover.py: using RAC 101 00:33:33.721934 tst handover.py: using CellId 37331 00:33:33.845349 tst handover.py: using BVCI 37332 00:33:33.961691 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:33.973090 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:33.984096 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:33.995283 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:34.007140 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:34.019073 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:33:34.136341 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:33:34.255757 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:34.722011 run create_hlr_db(pid=19401): Launched 00:33:34.842878 bus /sierra_2: Setting Powered False 00:33:35.905764 run create_hlr_db(pid=19401): Terminated: ok {rc=0} 00:33:36.305359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19403): Launched 00:33:36.602634 run osmo-hlr_10.42.42.2(pid=19404): Launched 00:33:36.715827 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:37.206383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19406): Launched 00:33:37.502408 run osmo-stp_10.42.42.5(pid=19407): Launched 00:33:37.615887 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:38.144335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19409): Launched 00:33:38.439828 run osmo-msc_10.42.42.6(pid=19410): Launched 00:33:38.605226 run osmo-stp_10.42.42.5(pid=19407): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19407)] 00:33:38.730417 run osmo-stp_10.42.42.5(pid=19407): stdout: | (launched: 2022-12-14_00:33:37.447954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:38.856148 run osmo-stp_10.42.42.5(pid=19407): stderr: | [0;m[38;5;43m20221214003337617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003337617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003337617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003337618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003337620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003337620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003337620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:38.979798 run osmo-stp_10.42.42.5(pid=19407): stdout: | (launched: 2022-12-14_00:33:37.447954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:39.097981 run osmo-stp_10.42.42.5(pid=19407): stderr: | [0;m[38;5;43m20221214003337617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003337617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003337617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003337618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003337620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003337620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003337620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:39.239060 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19407): Process ended prematurely: osmo-stp_10.42.42.5(pid=19407) [trial-2396↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19407)] [trial-2396↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 00:33:39.247242 tst handover.py:18: Test FAILED (6.3 sec) 00:33:39.273095 run osmo-hlr_10.42.42.2(pid=19404): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19404)] 00:33:39.320701 run osmo-hlr_10.42.42.2(pid=19404): stdout: | (launched: 2022-12-14_00:33:36.548424) 00:33:39.369801 run osmo-hlr_10.42.42.2(pid=19404): stderr: | [0;m[1;31m20221214003336724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003336724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003336724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003336724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003336724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003336724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003336736 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003336745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003336746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003336746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:39.438175 run osmo-msc_10.42.42.6(pid=19410): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19410)] 00:33:39.485052 run osmo-msc_10.42.42.6(pid=19410): stdout: | (launched: 2022-12-14_00:33:38.385821) 00:33:39.533532 run osmo-msc_10.42.42.6(pid=19410): stderr: | [0;m[38;5;43m20221214003338660 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003338660 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff33fcd3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003338660 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003338660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003338660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003338660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003338662 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003338663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003338663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003338663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:39.582189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19403): Terminating (SIGTERM) 00:33:39.621159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19406): Terminating (SIGTERM) 00:33:39.660615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19409): Terminating (SIGTERM) 00:33:39.700249 --- ParallelTerminationStrategy: PID 19403 died... 00:33:39.719325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19403): Terminated: ok {rc=0} 00:33:39.763025 --- ParallelTerminationStrategy: PID 19406 died... 00:33:39.781692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19406): Terminated: ok {rc=0} 00:33:39.825267 --- ParallelTerminationStrategy: PID 19409 died... 00:33:39.844001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19409): Terminated: ok {rc=0} 00:33:39.929824 bus /sierra_3: Setting Powered False 00:33:41.028178 bus /sierra_3: Setting Powered False 00:33:42.140882 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:33:43.417097 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:43.422644 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:33:43.483265 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:33:43.510297 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:33:43.561402 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:33:43.620770 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:33:43.647213 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:33:44.200272 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:33:44.206417 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:44.218157 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:33:44.263824 tst handover.py: using LAC 37332 00:33:44.388524 tst handover.py: using RAC 102 00:33:44.511196 tst handover.py: using CellId 37332 00:33:44.634970 tst handover.py: using BVCI 37333 00:33:44.751044 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:33:44.799473 tst handover.py: using LAC 37333 00:33:44.922179 tst handover.py: using RAC 103 00:33:45.045410 tst handover.py: using CellId 37333 00:33:45.162449 tst handover.py: using BVCI 37334 00:33:45.272173 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:45.283555 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:45.294787 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:45.306081 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:45.317410 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:45.328690 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:33:45.443811 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:33:45.562647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:46.035163 run create_hlr_db(pid=19415): Launched 00:33:46.185662 bus /sierra_2: Setting Powered False 00:33:47.244390 run create_hlr_db(pid=19415): Terminated: ok {rc=0} 00:33:47.659495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19417): Launched 00:33:47.978617 run osmo-hlr_10.42.42.2(pid=19418): Launched 00:33:48.100250 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:48.618929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19420): Launched 00:33:48.937478 run osmo-stp_10.42.42.5(pid=19421): Launched 00:33:49.059666 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:49.609250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19423): Launched 00:33:49.927882 run osmo-msc_10.42.42.6(pid=19424): Launched 00:33:50.106602 run osmo-stp_10.42.42.5(pid=19421): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19421)] 00:33:50.241173 run osmo-stp_10.42.42.5(pid=19421): stdout: | (launched: 2022-12-14_00:33:48.879903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:50.376732 run osmo-stp_10.42.42.5(pid=19421): stderr: | [0;m[38;5;43m20221214003349070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003349070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003349070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003349070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003349071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003349071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003349071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:50.511466 run osmo-stp_10.42.42.5(pid=19421): stdout: | (launched: 2022-12-14_00:33:48.879903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:50.638376 run osmo-stp_10.42.42.5(pid=19421): stderr: | [0;m[38;5;43m20221214003349070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003349070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003349070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003349070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003349071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003349071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003349071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:50.790624 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19421): Process ended prematurely: osmo-stp_10.42.42.5(pid=19421) [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19421)] [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 00:33:50.799493 tst handover.py:18: Test FAILED (6.6 sec) 00:33:50.826664 run osmo-hlr_10.42.42.2(pid=19418): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19418)] 00:33:50.877067 run osmo-hlr_10.42.42.2(pid=19418): stdout: | (launched: 2022-12-14_00:33:47.921272) 00:33:50.928487 run osmo-hlr_10.42.42.2(pid=19418): stderr: | [0;m[1;31m20221214003348120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003348120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003348120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003348121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003348121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003348121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003348158 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003348169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003348169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003348169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:51.000769 run osmo-msc_10.42.42.6(pid=19424): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19424)] 00:33:51.050345 run osmo-msc_10.42.42.6(pid=19424): stdout: | (launched: 2022-12-14_00:33:49.870302) 00:33:51.101857 run osmo-msc_10.42.42.6(pid=19424): stderr: | [0;m[38;5;43m20221214003350190 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003350190 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0b2d6eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003350190 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003350190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003350190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003350191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003350192 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003350193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003350193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003350193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:51.153890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19417): Terminating (SIGTERM) 00:33:51.195753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19420): Terminating (SIGTERM) 00:33:51.237361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19423): Terminating (SIGTERM) 00:33:51.279900 --- ParallelTerminationStrategy: PID 19417 died... 00:33:51.300219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19417): Terminated: ok {rc=0} 00:33:51.346638 --- ParallelTerminationStrategy: PID 19420 died... 00:33:51.366489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19420): Terminated: ok {rc=0} 00:33:51.412483 --- ParallelTerminationStrategy: PID 19423 died... 00:33:51.432178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19423): Terminated: ok {rc=0} 00:33:51.519531 bus /sierra_3: Setting Powered False 00:33:52.617693 bus /sierra_3: Setting Powered False 00:33:53.732726 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 00:33:55.004108 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:55.010028 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:33:55.055791 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:33:55.082140 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:33:55.134121 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:33:55.180247 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:33:55.206603 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:33:55.757114 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 00:33:55.762360 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:55.773474 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 00:33:55.816145 tst handover.py: using LAC 37334 00:33:55.932508 tst handover.py: using RAC 104 00:33:56.057467 tst handover.py: using CellId 37334 00:33:56.183656 tst handover.py: using BVCI 37335 00:33:56.300376 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 00:33:56.336153 tst handover.py: using LAC 37335 00:33:56.464209 tst handover.py: using RAC 105 00:33:56.588198 tst handover.py: using CellId 37335 00:33:56.710416 tst handover.py: using BVCI 37336 00:33:56.827340 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:56.838753 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:56.849933 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:56.861248 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:56.872797 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:56.884509 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 00:33:56.999790 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 00:33:57.119945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:57.585433 run create_hlr_db(pid=19429): Launched 00:33:57.707108 bus /sierra_2: Setting Powered False 00:33:58.769591 run create_hlr_db(pid=19429): Terminated: ok {rc=0} 00:33:59.170170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19431): Launched 00:33:59.466902 run osmo-hlr_10.42.42.2(pid=19432): Launched 00:33:59.580632 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:00.067453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19434): Launched 00:34:00.364074 run osmo-stp_10.42.42.5(pid=19435): Launched 00:34:00.476696 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:01.013838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19437): Launched 00:34:01.344308 run osmo-msc_10.42.42.6(pid=19438): Launched 00:34:01.654720 run osmo-stp_10.42.42.5(pid=19435): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19435)] 00:34:01.835400 run osmo-stp_10.42.42.5(pid=19435): stdout: | (launched: 2022-12-14_00:34:00.309841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:02.202171 run osmo-stp_10.42.42.5(pid=19435): stderr: | [0;m[38;5;43m20221214003400480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003400480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003400480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003400480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003400481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003400481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003400481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:02.363160 run osmo-stp_10.42.42.5(pid=19435): stdout: | (launched: 2022-12-14_00:34:00.309841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:02.490821 run osmo-stp_10.42.42.5(pid=19435): stderr: | [0;m[38;5;43m20221214003400480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003400480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003400480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003400480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003400481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003400481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003400481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:02.642580 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19435): Process ended prematurely: osmo-stp_10.42.42.5(pid=19435) [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19435)] [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 00:34:02.651490 tst handover.py:18: Test FAILED (6.9 sec) 00:34:02.678775 run osmo-hlr_10.42.42.2(pid=19432): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19432)] 00:34:02.730707 run osmo-hlr_10.42.42.2(pid=19432): stdout: | (launched: 2022-12-14_00:33:59.412543) 00:34:02.783058 run osmo-hlr_10.42.42.2(pid=19432): stderr: | [0;m[1;31m20221214003359587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003359587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003359587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003359587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003359587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003359587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003359599 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003359608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003359609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003359609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:02.856429 run osmo-msc_10.42.42.6(pid=19438): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19438)] 00:34:02.905982 run osmo-msc_10.42.42.6(pid=19438): stdout: | (launched: 2022-12-14_00:34:01.272814) 00:34:02.958339 run osmo-msc_10.42.42.6(pid=19438): stderr: | [0;m[38;5;43m20221214003401851 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003401851 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f04b0f41c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003401852 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003401852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003401852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003401852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003401863 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003401864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003401864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003401864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:03.010795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19431): Terminating (SIGTERM) 00:34:03.052855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19434): Terminating (SIGTERM) 00:34:03.095251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19437): Terminating (SIGTERM) 00:34:03.137672 --- ParallelTerminationStrategy: PID 19431 died... 00:34:03.158506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19431): Terminated: ok {rc=0} 00:34:03.205144 --- ParallelTerminationStrategy: PID 19434 died... 00:34:03.225453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19434): Terminated: ok {rc=0} 00:34:03.271817 --- ParallelTerminationStrategy: PID 19437 died... 00:34:03.292169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19437): Terminated: ok {rc=0} 00:34:03.380307 bus /sierra_3: Setting Powered False 00:34:04.477712 bus /sierra_3: Setting Powered False 00:34:05.592557 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 00:34:06.843043 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:06.848043 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:34:06.905777 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:34:06.931924 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:34:06.982298 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:34:07.040611 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:34:07.066834 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:34:07.619084 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 00:34:07.624481 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:07.635615 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:34:07.683395 tst handover.py: using LAC 37336 00:34:07.799531 tst handover.py: using RAC 106 00:34:07.914901 tst handover.py: using CellId 37336 00:34:08.033132 tst handover.py: using BVCI 37337 00:34:08.140221 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:34:08.187147 tst handover.py: using LAC 37337 00:34:08.310330 tst handover.py: using RAC 107 00:34:08.433691 tst handover.py: using CellId 37337 00:34:08.549373 tst handover.py: using BVCI 37338 00:34:08.659219 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:08.670447 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:08.681469 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:08.692406 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:08.703566 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:08.714738 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:34:08.830722 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:34:08.948744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:09.413351 run create_hlr_db(pid=19443): Launched 00:34:09.535714 bus /sierra_2: Setting Powered False 00:34:10.598855 run create_hlr_db(pid=19443): Terminated: ok {rc=0} 00:34:11.000172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19445): Launched 00:34:11.297548 run osmo-hlr_10.42.42.2(pid=19446): Launched 00:34:11.412182 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:11.899389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19448): Launched 00:34:12.197045 run osmo-stp_10.42.42.5(pid=19449): Launched 00:34:12.310120 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:12.822758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19451): Launched 00:34:13.119094 run osmo-msc_10.42.42.6(pid=19452): Launched 00:34:13.284699 run osmo-stp_10.42.42.5(pid=19449): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19449)] 00:34:13.410493 run osmo-stp_10.42.42.5(pid=19449): stdout: | (launched: 2022-12-14_00:34:12.142400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:13.537214 run osmo-stp_10.42.42.5(pid=19449): stderr: | [0;m[38;5;43m20221214003412312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003412313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003412313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003412313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003412314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003412314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003412314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:13.661370 run osmo-stp_10.42.42.5(pid=19449): stdout: | (launched: 2022-12-14_00:34:12.142400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:13.779370 run osmo-stp_10.42.42.5(pid=19449): stderr: | [0;m[38;5;43m20221214003412312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003412313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003412313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003412313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003412314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003412314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003412314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:13.920809 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19449): Process ended prematurely: osmo-stp_10.42.42.5(pid=19449) [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19449)] [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 00:34:13.928865 tst handover.py:18: Test FAILED (6.3 sec) 00:34:13.955781 run osmo-hlr_10.42.42.2(pid=19446): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19446)] 00:34:14.003595 run osmo-hlr_10.42.42.2(pid=19446): stdout: | (launched: 2022-12-14_00:34:11.243408) 00:34:14.052778 run osmo-hlr_10.42.42.2(pid=19446): stderr: | [0;m[1;31m20221214003411419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003411419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003411419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003411419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003411419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003411419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003411432 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003411442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003411442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003411442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:14.121559 run osmo-msc_10.42.42.6(pid=19452): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19452)] 00:34:14.168666 run osmo-msc_10.42.42.6(pid=19452): stdout: | (launched: 2022-12-14_00:34:13.064423) 00:34:14.217466 run osmo-msc_10.42.42.6(pid=19452): stderr: | [0;m[38;5;43m20221214003413335 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003413335 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faf3f9ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003413335 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003413335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003413336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003413336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003413338 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003413338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003413338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003413338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:14.266496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19445): Terminating (SIGTERM) 00:34:14.305542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19448): Terminating (SIGTERM) 00:34:14.344843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19451): Terminating (SIGTERM) 00:34:14.384048 --- ParallelTerminationStrategy: PID 19445 died... 00:34:14.403121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19445): Terminated: ok {rc=0} 00:34:14.446456 --- ParallelTerminationStrategy: PID 19448 died... 00:34:14.464940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19448): Terminated: ok {rc=0} 00:34:14.508202 --- ParallelTerminationStrategy: PID 19451 died... 00:34:14.526697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19451): Terminated: ok {rc=0} 00:34:14.611304 bus /sierra_3: Setting Powered False 00:34:15.708893 bus /sierra_3: Setting Powered False 00:34:16.823952 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 00:34:18.093964 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:18.099009 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:34:18.156067 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:34:18.182179 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:34:18.234845 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:34:18.293615 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:34:18.320680 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:34:18.869363 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 00:34:18.874535 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:18.885722 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:34:18.929059 tst handover.py: using LAC 37338 00:34:19.055531 tst handover.py: using RAC 108 00:34:19.179960 tst handover.py: using CellId 37338 00:34:19.304783 tst handover.py: using BVCI 37339 00:34:19.413626 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:34:19.460600 tst handover.py: using LAC 37339 00:34:19.577226 tst handover.py: using RAC 109 00:34:19.698566 tst handover.py: using CellId 37339 00:34:19.815915 tst handover.py: using BVCI 37340 00:34:19.932483 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:19.944070 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:19.955240 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:19.966603 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:19.978257 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:19.990302 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:34:20.105680 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:34:20.224504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:20.691172 run create_hlr_db(pid=19457): Launched 00:34:20.812724 bus /sierra_2: Setting Powered False 00:34:21.876285 run create_hlr_db(pid=19457): Terminated: ok {rc=0} 00:34:22.280133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19459): Launched 00:34:22.577977 run osmo-hlr_10.42.42.2(pid=19460): Launched 00:34:22.691445 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:23.182144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19462): Launched 00:34:23.478237 run osmo-stp_10.42.42.5(pid=19463): Launched 00:34:23.591147 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:24.103504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19465): Launched 00:34:24.400853 run osmo-msc_10.42.42.6(pid=19466): Launched 00:34:24.567540 run osmo-stp_10.42.42.5(pid=19463): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19463)] 00:34:24.693452 run osmo-stp_10.42.42.5(pid=19463): stdout: | (launched: 2022-12-14_00:34:23.424106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:24.819149 run osmo-stp_10.42.42.5(pid=19463): stderr: | [0;m[38;5;43m20221214003423593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003423593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003423593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003423594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003423596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003423596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003423596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:24.942922 run osmo-stp_10.42.42.5(pid=19463): stdout: | (launched: 2022-12-14_00:34:23.424106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:25.061289 run osmo-stp_10.42.42.5(pid=19463): stderr: | [0;m[38;5;43m20221214003423593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003423593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003423593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003423594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003423596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003423596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003423596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:25.202534 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19463): Process ended prematurely: osmo-stp_10.42.42.5(pid=19463) [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19463)] [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 00:34:25.210765 tst handover.py:18: Test FAILED (6.3 sec) 00:34:25.236570 run osmo-hlr_10.42.42.2(pid=19460): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19460)] 00:34:25.283991 run osmo-hlr_10.42.42.2(pid=19460): stdout: | (launched: 2022-12-14_00:34:22.523372) 00:34:25.333276 run osmo-hlr_10.42.42.2(pid=19460): stderr: | [0;m[1;31m20221214003422699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003422699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003422699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003422699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003422699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003422699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003422710 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003422720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003422720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003422720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:25.401691 run osmo-msc_10.42.42.6(pid=19466): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19466)] 00:34:25.448525 run osmo-msc_10.42.42.6(pid=19466): stdout: | (launched: 2022-12-14_00:34:24.346403) 00:34:25.497131 run osmo-msc_10.42.42.6(pid=19466): stderr: | [0;m[38;5;43m20221214003424618 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003424619 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f380f23dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003424619 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003424619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003424619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003424619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003424621 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003424621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003424622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003424622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:25.545903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19459): Terminating (SIGTERM) 00:34:25.584893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19462): Terminating (SIGTERM) 00:34:25.623849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19465): Terminating (SIGTERM) 00:34:25.663280 --- ParallelTerminationStrategy: PID 19459 died... 00:34:25.682511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19459): Terminated: ok {rc=0} 00:34:25.726299 --- ParallelTerminationStrategy: PID 19462 died... 00:34:25.744669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19462): Terminated: ok {rc=0} 00:34:25.788650 --- ParallelTerminationStrategy: PID 19465 died... 00:34:25.807693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19465): Terminated: ok {rc=0} 00:34:25.893134 bus /sierra_3: Setting Powered False 00:34:26.991551 bus /sierra_3: Setting Powered False 00:34:28.103941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 00:34:29.374862 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:29.380230 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:34:29.432637 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:34:29.459736 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:34:29.511143 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:34:29.563829 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:34:29.591043 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:34:30.144046 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 00:34:30.150360 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:30.162316 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 00:34:30.212213 tst handover.py: using LAC 37340 00:34:30.337059 tst handover.py: using RAC 110 00:34:30.463089 tst handover.py: using CellId 37340 00:34:30.587863 tst handover.py: using BVCI 37341 00:34:30.703987 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 00:34:30.739480 tst handover.py: using LAC 37341 00:34:30.871182 tst handover.py: using RAC 111 00:34:31.011013 tst handover.py: using CellId 37341 00:34:31.136719 tst handover.py: using BVCI 37342 00:34:31.255548 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:31.267398 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:31.279158 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:31.290920 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:31.303631 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:31.316387 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 00:34:31.438880 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 00:34:31.586943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:32.058669 run create_hlr_db(pid=19473): Launched 00:34:32.216865 bus /sierra_2: Setting Powered False 00:34:33.280565 run create_hlr_db(pid=19473): Terminated: ok {rc=0} 00:34:33.682323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19475): Launched 00:34:33.980304 run osmo-hlr_10.42.42.2(pid=19476): Launched 00:34:34.094443 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:34.598758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19478): Launched 00:34:34.896334 run osmo-stp_10.42.42.5(pid=19479): Launched 00:34:35.009987 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:35.522774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19481): Launched 00:34:35.819247 run osmo-msc_10.42.42.6(pid=19482): Launched 00:34:35.985498 run osmo-stp_10.42.42.5(pid=19479): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19479)] 00:34:36.112111 run osmo-stp_10.42.42.5(pid=19479): stdout: | (launched: 2022-12-14_00:34:34.841706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:36.238463 run osmo-stp_10.42.42.5(pid=19479): stderr: | [0;m[38;5;43m20221214003435013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003435013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003435014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003435014 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003435014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003435015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003435015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:36.362207 run osmo-stp_10.42.42.5(pid=19479): stdout: | (launched: 2022-12-14_00:34:34.841706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:36.480302 run osmo-stp_10.42.42.5(pid=19479): stderr: | [0;m[38;5;43m20221214003435013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003435013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003435014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003435014 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003435014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003435015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003435015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:36.621361 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19479): Process ended prematurely: osmo-stp_10.42.42.5(pid=19479) [trial-2396↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19479)] [trial-2396↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 00:34:36.629578 tst handover.py:18: Test FAILED (6.5 sec) 00:34:36.655280 run osmo-hlr_10.42.42.2(pid=19476): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19476)] 00:34:36.702112 run osmo-hlr_10.42.42.2(pid=19476): stdout: | (launched: 2022-12-14_00:34:33.925925) 00:34:36.751062 run osmo-hlr_10.42.42.2(pid=19476): stderr: | [0;m[1;31m20221214003434101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003434101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003434101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003434101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003434101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003434101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003434113 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003434123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003434123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003434124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:36.819226 run osmo-msc_10.42.42.6(pid=19482): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19482)] 00:34:36.865974 run osmo-msc_10.42.42.6(pid=19482): stdout: | (launched: 2022-12-14_00:34:35.765321) 00:34:36.914444 run osmo-msc_10.42.42.6(pid=19482): stderr: | [0;m[38;5;43m20221214003436037 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003436037 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc8471b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003436037 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003436037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003436037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003436037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003436039 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003436039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003436040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003436040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:36.963223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19475): Terminating (SIGTERM) 00:34:37.002263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19478): Terminating (SIGTERM) 00:34:37.041332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19481): Terminating (SIGTERM) 00:34:37.081594 --- ParallelTerminationStrategy: PID 19475 died... 00:34:37.100848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19475): Terminated: ok {rc=0} 00:34:37.144514 --- ParallelTerminationStrategy: PID 19478 died... 00:34:37.163022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19478): Terminated: ok {rc=0} 00:34:37.206647 --- ParallelTerminationStrategy: PID 19481 died... 00:34:37.225354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19481): Terminated: ok {rc=0} 00:34:37.309788 bus /sierra_3: Setting Powered False 00:34:38.408053 bus /sierra_3: Setting Powered False 00:34:39.522575 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 00:34:40.778060 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:40.783119 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:34:40.845181 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:34:40.871472 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:34:40.922414 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:34:40.988212 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:34:41.014501 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:34:41.562756 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 00:34:41.568107 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:41.579106 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:34:41.625825 tst handover.py: using LAC 37342 00:34:41.741891 tst handover.py: using RAC 112 00:34:41.859589 tst handover.py: using CellId 37342 00:34:41.977425 tst handover.py: using BVCI 37343 00:34:42.094984 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:34:42.145211 tst handover.py: using LAC 37343 00:34:42.263902 tst handover.py: using RAC 113 00:34:42.380469 tst handover.py: using CellId 37343 00:34:42.496807 tst handover.py: using BVCI 37344 00:34:42.604426 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:42.615509 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:42.626292 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:42.637001 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:42.647613 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:42.658363 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:34:42.779105 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:34:42.894734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:43.330297 run create_hlr_db(pid=19488): Launched 00:34:43.451830 bus /sierra_2: Setting Powered False 00:34:44.512022 run create_hlr_db(pid=19488): Terminated: ok {rc=0} 00:34:44.921729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19490): Launched 00:34:45.239987 run osmo-hlr_10.42.42.2(pid=19491): Launched 00:34:45.362265 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:45.894003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19493): Launched 00:34:46.233709 run osmo-stp_10.42.42.5(pid=19494): Launched 00:34:46.486040 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:47.139549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19496): Launched 00:34:47.449590 run osmo-msc_10.42.42.6(pid=19497): Launched 00:34:47.617419 run osmo-stp_10.42.42.5(pid=19494): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19494)] 00:34:47.744602 run osmo-stp_10.42.42.5(pid=19494): stdout: | (launched: 2022-12-14_00:34:46.162771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:47.871011 run osmo-stp_10.42.42.5(pid=19494): stderr: | [0;m[38;5;43m20221214003446455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003446456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003446456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003446456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003446463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003446463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003446463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:47.995008 run osmo-stp_10.42.42.5(pid=19494): stdout: | (launched: 2022-12-14_00:34:46.162771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:48.112840 run osmo-stp_10.42.42.5(pid=19494): stderr: | [0;m[38;5;43m20221214003446455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003446456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003446456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003446456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003446463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003446463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003446463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:48.254619 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19494): Process ended prematurely: osmo-stp_10.42.42.5(pid=19494) [trial-2396↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19494)] [trial-2396↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 00:34:48.262730 tst handover.py:18: Test FAILED (6.7 sec) 00:34:48.288617 run osmo-hlr_10.42.42.2(pid=19491): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19491)] 00:34:48.335711 run osmo-hlr_10.42.42.2(pid=19491): stdout: | (launched: 2022-12-14_00:34:45.182270) 00:34:48.384309 run osmo-hlr_10.42.42.2(pid=19491): stderr: | [0;m[1;31m20221214003445382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003445382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003445383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003445383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003445383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003445383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003445395 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003445403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003445404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003445404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:48.452250 run osmo-msc_10.42.42.6(pid=19497): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19497)] 00:34:48.499954 run osmo-msc_10.42.42.6(pid=19497): stdout: | (launched: 2022-12-14_00:34:47.394752) 00:34:48.548526 run osmo-msc_10.42.42.6(pid=19497): stderr: | [0;m[38;5;43m20221214003447664 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003447664 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa533fe5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003447664 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003447665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003447665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003447665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003447667 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003447667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003447667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003447667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:48.597540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19490): Terminating (SIGTERM) 00:34:48.636191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19493): Terminating (SIGTERM) 00:34:48.674790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19496): Terminating (SIGTERM) 00:34:48.713851 --- ParallelTerminationStrategy: PID 19490 died... 00:34:48.732660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19490): Terminated: ok {rc=0} 00:34:48.776085 --- ParallelTerminationStrategy: PID 19493 died... 00:34:48.794675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19493): Terminated: ok {rc=0} 00:34:48.837876 --- ParallelTerminationStrategy: PID 19496 died... 00:34:48.856269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19496): Terminated: ok {rc=0} 00:34:48.939843 bus /sierra_3: Setting Powered False 00:34:50.038157 bus /sierra_3: Setting Powered False 00:34:51.152208 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 00:34:52.422987 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:52.428169 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:34:52.489588 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:34:52.515811 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:34:52.566556 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:34:52.628689 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:34:52.654933 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:34:53.206019 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 00:34:53.211350 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:53.222586 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:34:53.270151 tst handover.py: using LAC 37344 00:34:53.386714 tst handover.py: using RAC 114 00:34:53.504650 tst handover.py: using CellId 37344 00:34:53.619963 tst handover.py: using BVCI 37345 00:34:53.727052 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:34:53.774150 tst handover.py: using LAC 37345 00:34:53.890562 tst handover.py: using RAC 115 00:34:54.006871 tst handover.py: using CellId 37345 00:34:54.127775 tst handover.py: using BVCI 37346 00:34:54.244691 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:54.256305 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:54.267761 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:54.279008 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:54.291329 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:54.303489 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:34:54.420192 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:34:54.536495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:55.001990 run create_hlr_db(pid=19503): Launched 00:34:55.123601 bus /sierra_2: Setting Powered False 00:34:56.187509 run create_hlr_db(pid=19503): Terminated: ok {rc=0} 00:34:56.604242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19505): Launched 00:34:56.923050 run osmo-hlr_10.42.42.2(pid=19506): Launched 00:34:57.044857 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:57.565783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19508): Launched 00:34:57.882939 run osmo-stp_10.42.42.5(pid=19509): Launched 00:34:58.004622 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:58.551264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19511): Launched 00:34:58.870266 run osmo-msc_10.42.42.6(pid=19512): Launched 00:34:59.048429 run osmo-stp_10.42.42.5(pid=19509): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19509)] 00:34:59.183832 run osmo-stp_10.42.42.5(pid=19509): stdout: | (launched: 2022-12-14_00:34:57.825239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:59.319825 run osmo-stp_10.42.42.5(pid=19509): stderr: | [0;m[38;5;43m20221214003458017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003458017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003458018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003458018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003458018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003458019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003458019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:59.454829 run osmo-stp_10.42.42.5(pid=19509): stdout: | (launched: 2022-12-14_00:34:57.825239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:59.581998 run osmo-stp_10.42.42.5(pid=19509): stderr: | [0;m[38;5;43m20221214003458017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003458017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003458018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003458018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003458018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003458019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003458019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:59.733770 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19509): Process ended prematurely: osmo-stp_10.42.42.5(pid=19509) [trial-2396↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19509)] [trial-2396↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 00:34:59.743208 tst handover.py:18: Test FAILED (6.5 sec) 00:34:59.770257 run osmo-hlr_10.42.42.2(pid=19506): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19506)] 00:34:59.820566 run osmo-hlr_10.42.42.2(pid=19506): stdout: | (launched: 2022-12-14_00:34:56.865212) 00:34:59.872058 run osmo-hlr_10.42.42.2(pid=19506): stderr: | [0;m[1;31m20221214003457063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003457063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003457063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003457063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003457063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003457063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003457087 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003457097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003457097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003457097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:59.944155 run osmo-msc_10.42.42.6(pid=19512): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19512)] 00:34:59.993208 run osmo-msc_10.42.42.6(pid=19512): stdout: | (launched: 2022-12-14_00:34:58.812599) 00:35:00.044630 run osmo-msc_10.42.42.6(pid=19512): stderr: | [0;m[38;5;43m20221214003459131 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003459132 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fda6dcd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003459132 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003459132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003459132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003459132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003459134 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003459134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003459134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003459134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:35:00.096689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19505): Terminating (SIGTERM) 00:35:00.138188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19508): Terminating (SIGTERM) 00:35:00.179879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19511): Terminating (SIGTERM) 00:35:00.221999 --- ParallelTerminationStrategy: PID 19505 died... 00:35:00.242423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19505): Terminated: ok {rc=0} 00:35:00.288517 --- ParallelTerminationStrategy: PID 19508 died... 00:35:00.308592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19508): Terminated: ok {rc=0} 00:35:00.354754 --- ParallelTerminationStrategy: PID 19511 died... 00:35:00.374706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19511): Terminated: ok {rc=0} 00:35:00.461126 bus /sierra_3: Setting Powered False 00:35:01.566666 bus /sierra_3: Setting Powered False 00:35:02.682272 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 00:35:03.953140 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:35:03.958462 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:35:04.007947 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:35:04.034113 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:35:04.084600 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:35:04.134261 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:35:04.160536 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:35:04.713848 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 00:35:04.719088 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:04.729964 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:35:04.763863 tst handover.py: using LAC 37346 00:35:04.881661 tst handover.py: using RAC 116 00:35:05.001261 tst handover.py: using CellId 37346 00:35:05.117272 tst handover.py: using BVCI 37347 00:35:05.224801 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:35:05.272857 tst handover.py: using LAC 37347 00:35:05.391416 tst handover.py: using RAC 117 00:35:05.508170 tst handover.py: using CellId 37347 00:35:05.628710 tst handover.py: using BVCI 37348 00:35:05.746144 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:05.757604 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:05.768659 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:05.779685 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:05.791422 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:05.802820 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:35:05.922332 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:35:06.042337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:35:06.507569 run create_hlr_db(pid=19520): Launched 00:35:06.630331 bus /sierra_2: Setting Powered False 00:35:07.693934 run create_hlr_db(pid=19520): Terminated: ok {rc=0} 00:35:08.111087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19522): Launched 00:35:08.430177 run osmo-hlr_10.42.42.2(pid=19523): Launched 00:35:08.551943 run osmo-stp_10.42.42.5: Starting osmo-stp 00:35:09.073619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19525): Launched 00:35:09.391812 run osmo-stp_10.42.42.5(pid=19526): Launched 00:35:09.513501 run osmo-msc_10.42.42.6: Starting osmo-msc 00:35:10.061712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19528): Launched 00:35:10.380008 run osmo-msc_10.42.42.6(pid=19529): Launched 00:35:10.558402 run osmo-stp_10.42.42.5(pid=19526): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19526)] 00:35:10.697259 run osmo-stp_10.42.42.5(pid=19526): stdout: | (launched: 2022-12-14_00:35:09.333950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:10.830472 run osmo-stp_10.42.42.5(pid=19526): stderr: | [0;m[38;5;43m20221214003509526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003509526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003509526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003509527 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003509527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003509527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003509527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:10.963836 run osmo-stp_10.42.42.5(pid=19526): stdout: | (launched: 2022-12-14_00:35:09.333950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:11.091452 run osmo-stp_10.42.42.5(pid=19526): stderr: | [0;m[38;5;43m20221214003509526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003509526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003509526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003509527 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003509527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003509527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003509527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:11.243889 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19526): Process ended prematurely: osmo-stp_10.42.42.5(pid=19526) [trial-2396↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19526)] [trial-2396↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 00:35:11.252906 tst handover.py:18: Test FAILED (6.5 sec) 00:35:11.280471 run osmo-hlr_10.42.42.2(pid=19523): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19523)] 00:35:11.331454 run osmo-hlr_10.42.42.2(pid=19523): stdout: | (launched: 2022-12-14_00:35:08.372177) 00:35:11.384088 run osmo-hlr_10.42.42.2(pid=19523): stderr: | [0;m[1;31m20221214003508568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003508569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003508569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003508569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003508569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003508569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003508581 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003508589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003508590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003508590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:35:11.457136 run osmo-msc_10.42.42.6(pid=19529): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19529)] 00:35:11.507430 run osmo-msc_10.42.42.6(pid=19529): stdout: | (launched: 2022-12-14_00:35:10.322220) 00:35:11.560177 run osmo-msc_10.42.42.6(pid=19529): stderr: | [0;m[38;5;43m20221214003510642 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003510642 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd4a373fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003510642 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003510642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003510642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003510643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003510644 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003510645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003510645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003510645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:35:11.613064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19522): Terminating (SIGTERM) 00:35:11.654688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19525): Terminating (SIGTERM) 00:35:11.697084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19528): Terminating (SIGTERM) 00:35:11.739755 --- ParallelTerminationStrategy: PID 19522 died... 00:35:11.760832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19522): Terminated: ok {rc=0} 00:35:11.807513 --- ParallelTerminationStrategy: PID 19525 died... 00:35:11.827709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19525): Terminated: ok {rc=0} 00:35:11.874377 --- ParallelTerminationStrategy: PID 19528 died... 00:35:11.894501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19528): Terminated: ok {rc=0} 00:35:11.983062 bus /sierra_3: Setting Powered False 00:35:13.081475 bus /sierra_3: Setting Powered False 00:35:14.199341 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 00:35:15.459501 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:35:15.465238 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:35:15.517219 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:35:15.544324 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:35:15.596749 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:35:15.648618 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:35:15.675985 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:35:16.246011 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 00:35:16.253095 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:16.265623 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:16.305921 tst handover.py: using LAC 37348 00:35:16.435177 tst handover.py: using RAC 118 00:35:16.563978 tst handover.py: using CellId 37348 00:35:16.718933 tst handover.py: using BVCI 37349 00:35:16.838808 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:16.886504 tst handover.py: using LAC 37349 00:35:17.012434 tst handover.py: using RAC 119 00:35:17.138142 tst handover.py: using CellId 37349 00:35:17.261240 tst handover.py: using BVCI 37350 00:35:17.369962 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:17.380789 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:17.391539 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:17.402057 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:17.412569 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:17.423770 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:17.545075 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:17.660871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:35:18.098781 run create_hlr_db(pid=19534): Launched 00:35:18.220928 bus /sierra_2: Setting Powered False 00:35:19.280602 run create_hlr_db(pid=19534): Terminated: ok {rc=0} 00:35:19.689808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19536): Launched 00:35:20.008281 run osmo-hlr_10.42.42.2(pid=19537): Launched 00:35:20.130592 run osmo-stp_10.42.42.5: Starting osmo-stp 00:35:20.650895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19539): Launched 00:35:20.971066 run osmo-stp_10.42.42.5(pid=19540): Launched 00:35:21.093897 run osmo-msc_10.42.42.6: Starting osmo-msc 00:35:21.643939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19542): Launched 00:35:21.963677 run osmo-msc_10.42.42.6(pid=19543): Launched 00:35:22.143286 run osmo-stp_10.42.42.5(pid=19540): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19540)] 00:35:22.278530 run osmo-stp_10.42.42.5(pid=19540): stdout: | (launched: 2022-12-14_00:35:20.913151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:22.414254 run osmo-stp_10.42.42.5(pid=19540): stderr: | [0;m[38;5;43m20221214003521104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003521104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003521104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003521105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003521105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003521105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003521105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:22.549354 run osmo-stp_10.42.42.5(pid=19540): stdout: | (launched: 2022-12-14_00:35:20.913151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:22.676914 run osmo-stp_10.42.42.5(pid=19540): stderr: | [0;m[38;5;43m20221214003521104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003521104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003521104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003521105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003521105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003521105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003521105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:22.829543 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19540): Process ended prematurely: osmo-stp_10.42.42.5(pid=19540) [trial-2396↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19540)] [trial-2396↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 00:35:22.838449 tst handover.py:18: Test FAILED (6.6 sec) 00:35:22.865837 run osmo-hlr_10.42.42.2(pid=19537): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19537)] 00:35:22.916780 run osmo-hlr_10.42.42.2(pid=19537): stdout: | (launched: 2022-12-14_00:35:19.950769) 00:35:22.968645 run osmo-hlr_10.42.42.2(pid=19537): stderr: | [0;m[1;31m20221214003520150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003520150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003520150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003520150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003520150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003520150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003520162 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003520172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003520172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003520172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:35:23.041512 run osmo-msc_10.42.42.6(pid=19543): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19543)] 00:35:23.091352 run osmo-msc_10.42.42.6(pid=19543): stdout: | (launched: 2022-12-14_00:35:21.905870) 00:35:23.143321 run osmo-msc_10.42.42.6(pid=19543): stderr: | [0;m[38;5;43m20221214003522228 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003522229 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5fe35fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003522229 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003522229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003522229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003522229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003522231 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003522231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003522232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003522232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:35:23.194972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19536): Terminating (SIGTERM) 00:35:23.236843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19539): Terminating (SIGTERM) 00:35:23.279191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19542): Terminating (SIGTERM) 00:35:23.321602 --- ParallelTerminationStrategy: PID 19536 died... 00:35:23.342164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19536): Terminated: ok {rc=0} 00:35:23.388679 --- ParallelTerminationStrategy: PID 19539 died... 00:35:23.408654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19539): Terminated: ok {rc=0} 00:35:23.454821 --- ParallelTerminationStrategy: PID 19542 died... 00:35:23.474801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19542): Terminated: ok {rc=0} 00:35:23.562812 bus /sierra_3: Setting Powered False 00:35:24.661582 bus /sierra_3: Setting Powered False 00:35:25.778973 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2396 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 00:35:27.036335 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:35:27.042052 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:35:27.106098 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:35:27.133622 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:35:27.187384 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:35:27.249958 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:35:27.276212 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:35:27.829618 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2396 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 00:35:27.836049 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:27.847893 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:27.897301 tst handover.py: using LAC 37350 00:35:28.023275 tst handover.py: using RAC 120 00:35:28.150816 tst handover.py: using CellId 37350 00:35:28.278099 tst handover.py: using BVCI 37351 00:35:28.395830 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:28.444655 tst handover.py: using LAC 37351 00:35:28.572082 tst handover.py: using RAC 121 00:35:28.699287 tst handover.py: using CellId 37351 00:35:28.825428 tst handover.py: using BVCI 37352 00:35:28.942995 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:28.954648 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:28.966097 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:28.977510 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:28.989392 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:29.001271 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:29.117416 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:29.238458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:35:29.705311 run create_hlr_db(pid=19548): Launched 00:35:29.827392 bus /sierra_2: Setting Powered False 00:35:30.902227 run create_hlr_db(pid=19548): Terminated: ok {rc=0} 00:35:31.353709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19565): Launched 00:35:31.701665 run osmo-hlr_10.42.42.2(pid=19570): Launched 00:35:31.941709 run osmo-stp_10.42.42.5: Starting osmo-stp 00:35:32.677733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19573): Launched 00:35:33.009655 run osmo-stp_10.42.42.5(pid=19574): Launched 00:35:33.245405 run osmo-msc_10.42.42.6: Starting osmo-msc 00:35:33.856372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19576): Launched 00:35:34.193850 run osmo-msc_10.42.42.6(pid=19593): Launched 00:35:34.458915 run osmo-stp_10.42.42.5(pid=19574): ERR: Terminated: ERROR {rc=1} [trial-2396↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19574)] 00:35:34.590559 run osmo-stp_10.42.42.5(pid=19574): stdout: | (launched: 2022-12-14_00:35:32.936359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:34.718826 run osmo-stp_10.42.42.5(pid=19574): stderr: | [0;m[38;5;43m20221214003533268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003533268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003533268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003533269 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003533269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003533269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003533269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:34.843745 run osmo-stp_10.42.42.5(pid=19574): stdout: | (launched: 2022-12-14_00:35:32.936359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:34.962337 run osmo-stp_10.42.42.5(pid=19574): stderr: | [0;m[38;5;43m20221214003533268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214003533268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214003533268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214003533269 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214003533269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214003533269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214003533269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:35.103698 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19574): Process ended prematurely: osmo-stp_10.42.42.5(pid=19574) [trial-2396↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19574)] [trial-2396↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 00:35:35.111975 tst handover.py:18: Test FAILED (7.3 sec) 00:35:35.138068 run osmo-hlr_10.42.42.2(pid=19570): ERR: Terminated: ERROR {rc=237} [trial-2396↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19570)] 00:35:35.185742 run osmo-hlr_10.42.42.2(pid=19570): stdout: | (launched: 2022-12-14_00:35:31.637503) 00:35:35.235135 run osmo-hlr_10.42.42.2(pid=19570): stderr: | [0;m[1;31m20221214003531964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214003531964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214003531964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214003531965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214003531965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214003531965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214003531985 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214003532006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214003532006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214003532006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:35:35.303785 run osmo-msc_10.42.42.6(pid=19593): ERR: Terminated: ERROR {rc=2} [trial-2396↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19593)] 00:35:35.351682 run osmo-msc_10.42.42.6(pid=19593): stdout: | (launched: 2022-12-14_00:35:34.121345) 00:35:35.400891 run osmo-msc_10.42.42.6(pid=19593): stderr: | [0;m[38;5;43m20221214003534535 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214003534535 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa232c3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214003534535 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214003534535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214003534536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214003534536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214003534538 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214003534538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214003534538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214003534538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:35:35.450423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19565): Terminating (SIGTERM) 00:35:35.489838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19573): Terminating (SIGTERM) 00:35:35.529533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19576): Terminating (SIGTERM) 00:35:35.569406 --- ParallelTerminationStrategy: PID 19565 died... 00:35:35.588135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19565): Terminated: ok {rc=0} 00:35:35.632221 --- ParallelTerminationStrategy: PID 19573 died... 00:35:35.650931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19573): Terminated: ok {rc=0} 00:35:35.694842 --- ParallelTerminationStrategy: PID 19576 died... 00:35:35.713603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19576): Terminated: ok {rc=0} 00:35:35.796850 bus /sierra_3: Setting Powered False 00:35:36.891278 bus /sierra_3: Setting Powered False 00:35:38.006027 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2396 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 00:35:39.281453 tst trial-2396: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396/run.2022-12-13_23-11-51/trial-2396.xml -------------------------------------------------------------------------------------------- trial-2396 FAIL -------------------------------------------------------------------------------------------- 00:35:41.209607 tst trial-2396: trial-2396: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=11899): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11899) [trial-2396↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11899)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.3 sec) Error: osmo-stp_10.42.42.5(pid=11909): Process ended prematurely: osmo-stp_10.42.42.5(pid=11909) [trial-2396↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11909)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=11918): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11918) [trial-2396↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11918)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=11930): Process ended prematurely: osmo-stp_10.42.42.5(pid=11930) [trial-2396↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11930)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11944): Process ended prematurely: osmo-stp_10.42.42.5(pid=11944) [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11944)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11955): Process ended prematurely: osmo-stp_10.42.42.5(pid=11955) [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11955)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11972): Process ended prematurely: osmo-stp_10.42.42.5(pid=11972) [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11972)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11983): Process ended prematurely: osmo-stp_10.42.42.5(pid=11983) [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11983)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11998): Process ended prematurely: osmo-stp_10.42.42.5(pid=11998) [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11998)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12009): Process ended prematurely: osmo-stp_10.42.42.5(pid=12009) [trial-2396↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12009)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12023): Process ended prematurely: osmo-stp_10.42.42.5(pid=12023) [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12023)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12037): Process ended prematurely: osmo-stp_10.42.42.5(pid=12037) [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12037)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12051): Process ended prematurely: osmo-stp_10.42.42.5(pid=12051) [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12051)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12062): Process ended prematurely: osmo-stp_10.42.42.5(pid=12062) [trial-2396↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12062)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12076): Process ended prematurely: osmo-stp_10.42.42.5(pid=12076) [trial-2396↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12076)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12087): Process ended prematurely: osmo-stp_10.42.42.5(pid=12087) [trial-2396↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12087)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12101): Process ended prematurely: osmo-stp_10.42.42.5(pid=12101) [trial-2396↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12101)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12115): Process ended prematurely: osmo-stp_10.42.42.5(pid=12115) [trial-2396↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12115)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12129): Process ended prematurely: osmo-stp_10.42.42.5(pid=12129) [trial-2396↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12129)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12140): Process ended prematurely: osmo-stp_10.42.42.5(pid=12140) [trial-2396↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12140)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.8 sec) Error: osmo-stp_10.42.42.5(pid=12158): Process ended prematurely: osmo-stp_10.42.42.5(pid=12158) [trial-2396↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12158)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=12170): Process ended prematurely: osmo-stp_10.42.42.5(pid=12170) [trial-2396↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12170)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=12188): Process ended prematurely: osmo-stp_10.42.42.5(pid=12188) [trial-2396↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12188)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12198): Process ended prematurely: osmo-stp_10.42.42.5(pid=12198) [trial-2396↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12198)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12209): Process ended prematurely: osmo-stp_10.42.42.5(pid=12209) [trial-2396↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12209)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=12226): Process ended prematurely: osmo-stp_10.42.42.5(pid=12226) [trial-2396↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12226)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=12238): Process ended prematurely: osmo-stp_10.42.42.5(pid=12238) [trial-2396↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12238)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=12256): Process ended prematurely: osmo-stp_10.42.42.5(pid=12256) [trial-2396↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12256)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12266): Process ended prematurely: osmo-stp_10.42.42.5(pid=12266) [trial-2396↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12266)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12276): Process ended prematurely: osmo-stp_10.42.42.5(pid=12276) [trial-2396↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12276)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=12293): Process ended prematurely: osmo-stp_10.42.42.5(pid=12293) [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12293)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=12305): Process ended prematurely: osmo-stp_10.42.42.5(pid=12305) [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12305)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=12326): Process ended prematurely: osmo-stp_10.42.42.5(pid=12326) [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12326)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12336): Process ended prematurely: osmo-stp_10.42.42.5(pid=12336) [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12336)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12347): Process ended prematurely: osmo-stp_10.42.42.5(pid=12347) [trial-2396↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12347)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=12365): Process ended prematurely: osmo-stp_10.42.42.5(pid=12365) [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12365)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=12380): Process ended prematurely: osmo-stp_10.42.42.5(pid=12380) [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12380)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=12398): Process ended prematurely: osmo-stp_10.42.42.5(pid=12398) [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12398)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12408): Process ended prematurely: osmo-stp_10.42.42.5(pid=12408) [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12408)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12418): Process ended prematurely: osmo-stp_10.42.42.5(pid=12418) [trial-2396↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12418)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=12432): Process ended prematurely: osmo-stp_10.42.42.5(pid=12432) [trial-2396↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12432)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12445): Process ended prematurely: osmo-stp_10.42.42.5(pid=12445) [trial-2396↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12445)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12453): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12453) [trial-2396↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12453)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12463): Process ended prematurely: osmo-stp_10.42.42.5(pid=12463) [trial-2396↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12463)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=12472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12472) [trial-2396↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12472)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12482): Process ended prematurely: osmo-stp_10.42.42.5(pid=12482) [trial-2396↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12482)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12496): Process ended prematurely: osmo-stp_10.42.42.5(pid=12496) [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12496)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12507): Process ended prematurely: osmo-stp_10.42.42.5(pid=12507) [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12507)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12521): Process ended prematurely: osmo-stp_10.42.42.5(pid=12521) [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12521)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12532): Process ended prematurely: osmo-stp_10.42.42.5(pid=12532) [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12532)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12546): Process ended prematurely: osmo-stp_10.42.42.5(pid=12546) [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12546)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12557): Process ended prematurely: osmo-stp_10.42.42.5(pid=12557) [trial-2396↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12557)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12571): Process ended prematurely: osmo-stp_10.42.42.5(pid=12571) [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12571)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12583): Process ended prematurely: osmo-stp_10.42.42.5(pid=12583) [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12583)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=12868): Process ended prematurely: osmo-stp_10.42.42.5(pid=12868) [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12868)] FAIL: mo_mt_call_osmux.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=12879): Process ended prematurely: osmo-stp_10.42.42.5(pid=12879) [trial-2396↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12879)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12893): Process ended prematurely: osmo-stp_10.42.42.5(pid=12893) [trial-2396↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12893)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12904): Process ended prematurely: osmo-stp_10.42.42.5(pid=12904) [trial-2396↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12904)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12918): Process ended prematurely: osmo-stp_10.42.42.5(pid=12918) [trial-2396↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12918)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12932): Process ended prematurely: osmo-stp_10.42.42.5(pid=12932) [trial-2396↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12932)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12946): Process ended prematurely: osmo-stp_10.42.42.5(pid=12946) [trial-2396↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12946)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12957): Process ended prematurely: osmo-stp_10.42.42.5(pid=12957) [trial-2396↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12957)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=12977): Process ended prematurely: osmo-stp_10.42.42.5(pid=12977) [trial-2396↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12977)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=12991): Process ended prematurely: osmo-stp_10.42.42.5(pid=12991) [trial-2396↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12991)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=13009): Process ended prematurely: osmo-stp_10.42.42.5(pid=13009) [trial-2396↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13009)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13019): Process ended prematurely: osmo-stp_10.42.42.5(pid=13019) [trial-2396↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13019)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13029): Process ended prematurely: osmo-stp_10.42.42.5(pid=13029) [trial-2396↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13029)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=13046): Process ended prematurely: osmo-stp_10.42.42.5(pid=13046) [trial-2396↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13046)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13058): Process ended prematurely: osmo-stp_10.42.42.5(pid=13058) [trial-2396↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13058)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=13076): Process ended prematurely: osmo-stp_10.42.42.5(pid=13076) [trial-2396↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13076)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13086): Process ended prematurely: osmo-stp_10.42.42.5(pid=13086) [trial-2396↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13086)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13096): Process ended prematurely: osmo-stp_10.42.42.5(pid=13096) [trial-2396↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13096)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=13113): Process ended prematurely: osmo-stp_10.42.42.5(pid=13113) [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13113)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=13126): Process ended prematurely: osmo-stp_10.42.42.5(pid=13126) [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13126)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=13144): Process ended prematurely: osmo-stp_10.42.42.5(pid=13144) [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13144)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13154): Process ended prematurely: osmo-stp_10.42.42.5(pid=13154) [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13154)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13164): Process ended prematurely: osmo-stp_10.42.42.5(pid=13164) [trial-2396↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13164)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13181): Process ended prematurely: osmo-stp_10.42.42.5(pid=13181) [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13181)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13193): Process ended prematurely: osmo-stp_10.42.42.5(pid=13193) [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13193)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=13211): Process ended prematurely: osmo-stp_10.42.42.5(pid=13211) [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13211)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13222): Process ended prematurely: osmo-stp_10.42.42.5(pid=13222) [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13222)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13232): Process ended prematurely: osmo-stp_10.42.42.5(pid=13232) [trial-2396↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13232)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13246): Process ended prematurely: osmo-stp_10.42.42.5(pid=13246) [trial-2396↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13246)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13259): Process ended prematurely: osmo-stp_10.42.42.5(pid=13259) [trial-2396↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13259)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=13269): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13269) [trial-2396↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13269)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13287): Process ended prematurely: osmo-stp_10.42.42.5(pid=13287) [trial-2396↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13287)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=13296): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13296) [trial-2396↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13296)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=13306): Process ended prematurely: osmo-stp_10.42.42.5(pid=13306) [trial-2396↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13306)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13320): Process ended prematurely: osmo-stp_10.42.42.5(pid=13320) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13320)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13331): Process ended prematurely: osmo-stp_10.42.42.5(pid=13331) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13331)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13345): Process ended prematurely: osmo-stp_10.42.42.5(pid=13345) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13345)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13357): Process ended prematurely: osmo-stp_10.42.42.5(pid=13357) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13357)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13371): Process ended prematurely: osmo-stp_10.42.42.5(pid=13371) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13371)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13382): Process ended prematurely: osmo-stp_10.42.42.5(pid=13382) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13382)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13396): Process ended prematurely: osmo-stp_10.42.42.5(pid=13396) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13396)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13407): Process ended prematurely: osmo-stp_10.42.42.5(pid=13407) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13407)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13421): Process ended prematurely: osmo-stp_10.42.42.5(pid=13421) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13421)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13432): Process ended prematurely: osmo-stp_10.42.42.5(pid=13432) [trial-2396↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13432)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13446): Process ended prematurely: osmo-stp_10.42.42.5(pid=13446) [trial-2396↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13446)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13457): Process ended prematurely: osmo-stp_10.42.42.5(pid=13457) [trial-2396↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13457)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13471): Process ended prematurely: osmo-stp_10.42.42.5(pid=13471) [trial-2396↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13471)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13482): Process ended prematurely: osmo-stp_10.42.42.5(pid=13482) [trial-2396↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13482)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13499): Process ended prematurely: osmo-stp_10.42.42.5(pid=13499) [trial-2396↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13499)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13511): Process ended prematurely: osmo-stp_10.42.42.5(pid=13511) [trial-2396↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13511)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13525): Process ended prematurely: osmo-stp_10.42.42.5(pid=13525) [trial-2396↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13525)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13536): Process ended prematurely: osmo-stp_10.42.42.5(pid=13536) [trial-2396↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13536)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13550): Process ended prematurely: osmo-stp_10.42.42.5(pid=13550) [trial-2396↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13550)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13561): Process ended prematurely: osmo-stp_10.42.42.5(pid=13561) [trial-2396↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13561)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13580): Process ended prematurely: osmo-stp_10.42.42.5(pid=13580) [trial-2396↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13580)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13592): Process ended prematurely: osmo-stp_10.42.42.5(pid=13592) [trial-2396↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13592)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=13610): Process ended prematurely: osmo-stp_10.42.42.5(pid=13610) [trial-2396↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13610)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13620): Process ended prematurely: osmo-stp_10.42.42.5(pid=13620) [trial-2396↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13620)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13630): Process ended prematurely: osmo-stp_10.42.42.5(pid=13630) [trial-2396↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13630)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13650): Process ended prematurely: osmo-stp_10.42.42.5(pid=13650) [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13650)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=13662): Process ended prematurely: osmo-stp_10.42.42.5(pid=13662) [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13662)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=13680): Process ended prematurely: osmo-stp_10.42.42.5(pid=13680) [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13680)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13690): Process ended prematurely: osmo-stp_10.42.42.5(pid=13690) [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13690)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13701): Process ended prematurely: osmo-stp_10.42.42.5(pid=13701) [trial-2396↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13701)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=13718): Process ended prematurely: osmo-stp_10.42.42.5(pid=13718) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13718)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13731): Process ended prematurely: osmo-stp_10.42.42.5(pid=13731) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13731)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=13749): Process ended prematurely: osmo-stp_10.42.42.5(pid=13749) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13749)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13759): Process ended prematurely: osmo-stp_10.42.42.5(pid=13759) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13759)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13769): Process ended prematurely: osmo-stp_10.42.42.5(pid=13769) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13769)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13787): Process ended prematurely: osmo-stp_10.42.42.5(pid=13787) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13787)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13799): Process ended prematurely: osmo-stp_10.42.42.5(pid=13799) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13799)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=13819): Process ended prematurely: osmo-stp_10.42.42.5(pid=13819) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13819)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13829): Process ended prematurely: osmo-stp_10.42.42.5(pid=13829) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13829)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13839): Process ended prematurely: osmo-stp_10.42.42.5(pid=13839) [trial-2396↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13839)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=13856): Process ended prematurely: osmo-stp_10.42.42.5(pid=13856) [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13856)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=13868): Process ended prematurely: osmo-stp_10.42.42.5(pid=13868) [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13868)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=13886): Process ended prematurely: osmo-stp_10.42.42.5(pid=13886) [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13886)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13896): Process ended prematurely: osmo-stp_10.42.42.5(pid=13896) [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13896)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13907): Process ended prematurely: osmo-stp_10.42.42.5(pid=13907) [trial-2396↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13907)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=14191): Process ended prematurely: osmo-stp_10.42.42.5(pid=14191) [trial-2396↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14191)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=14205): Process ended prematurely: osmo-stp_10.42.42.5(pid=14205) [trial-2396↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14205)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=14215): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14215) [trial-2396↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14215)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14225): Process ended prematurely: osmo-stp_10.42.42.5(pid=14225) [trial-2396↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14225)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=14234): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14234) [trial-2396↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14234)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14245): Process ended prematurely: osmo-stp_10.42.42.5(pid=14245) [trial-2396↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14245)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14263): Process ended prematurely: osmo-stp_10.42.42.5(pid=14263) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14263)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=14274): Process ended prematurely: osmo-stp_10.42.42.5(pid=14274) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14274)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=14288): Process ended prematurely: osmo-stp_10.42.42.5(pid=14288) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14288)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=14299): Process ended prematurely: osmo-stp_10.42.42.5(pid=14299) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14299)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14313): Process ended prematurely: osmo-stp_10.42.42.5(pid=14313) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14313)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14325): Process ended prematurely: osmo-stp_10.42.42.5(pid=14325) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14325)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14339): Process ended prematurely: osmo-stp_10.42.42.5(pid=14339) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14339)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14350): Process ended prematurely: osmo-stp_10.42.42.5(pid=14350) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14350)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=14365): Process ended prematurely: osmo-stp_10.42.42.5(pid=14365) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14365)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14376): Process ended prematurely: osmo-stp_10.42.42.5(pid=14376) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14376)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14390): Process ended prematurely: osmo-stp_10.42.42.5(pid=14390) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14390)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14401): Process ended prematurely: osmo-stp_10.42.42.5(pid=14401) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14401)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14418): Process ended prematurely: osmo-stp_10.42.42.5(pid=14418) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14418)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14429): Process ended prematurely: osmo-stp_10.42.42.5(pid=14429) [trial-2396↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14429)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14443): Process ended prematurely: osmo-stp_10.42.42.5(pid=14443) [trial-2396↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14443)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14454): Process ended prematurely: osmo-stp_10.42.42.5(pid=14454) [trial-2396↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14454)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=14472): Process ended prematurely: osmo-stp_10.42.42.5(pid=14472) [trial-2396↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14472)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=14484): Process ended prematurely: osmo-stp_10.42.42.5(pid=14484) [trial-2396↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14484)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=14502): Process ended prematurely: osmo-stp_10.42.42.5(pid=14502) [trial-2396↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14502)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14512): Process ended prematurely: osmo-stp_10.42.42.5(pid=14512) [trial-2396↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14512)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14522): Process ended prematurely: osmo-stp_10.42.42.5(pid=14522) [trial-2396↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14522)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=14540): Process ended prematurely: osmo-stp_10.42.42.5(pid=14540) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14540)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=14552): Process ended prematurely: osmo-stp_10.42.42.5(pid=14552) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14552)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=14570): Process ended prematurely: osmo-stp_10.42.42.5(pid=14570) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14570)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14580): Process ended prematurely: osmo-stp_10.42.42.5(pid=14580) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14580)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14590): Process ended prematurely: osmo-stp_10.42.42.5(pid=14590) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14590)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=14607): Process ended prematurely: osmo-stp_10.42.42.5(pid=14607) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14607)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=14623): Process ended prematurely: osmo-stp_10.42.42.5(pid=14623) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14623)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=14641): Process ended prematurely: osmo-stp_10.42.42.5(pid=14641) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14641)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14651): Process ended prematurely: osmo-stp_10.42.42.5(pid=14651) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14651)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14661): Process ended prematurely: osmo-stp_10.42.42.5(pid=14661) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14661)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=14684): Process ended prematurely: osmo-stp_10.42.42.5(pid=14684) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14684)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=14696): Process ended prematurely: osmo-stp_10.42.42.5(pid=14696) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14696)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=14714): Process ended prematurely: osmo-stp_10.42.42.5(pid=14714) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14714)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14725): Process ended prematurely: osmo-stp_10.42.42.5(pid=14725) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14725)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14735): Process ended prematurely: osmo-stp_10.42.42.5(pid=14735) [trial-2396↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14735)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14748): Process ended prematurely: osmo-stp_10.42.42.5(pid=14748) [trial-2396↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14748)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14761): Process ended prematurely: osmo-stp_10.42.42.5(pid=14761) [trial-2396↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14761)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=14769): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14769) [trial-2396↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14769)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=14779): Process ended prematurely: osmo-stp_10.42.42.5(pid=14779) [trial-2396↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14779)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=14788): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14788) [trial-2396↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14788)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=14798): Process ended prematurely: osmo-stp_10.42.42.5(pid=14798) [trial-2396↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14798)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14812): Process ended prematurely: osmo-stp_10.42.42.5(pid=14812) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14812)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14823): Process ended prematurely: osmo-stp_10.42.42.5(pid=14823) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14823)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14838): Process ended prematurely: osmo-stp_10.42.42.5(pid=14838) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14838)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14849): Process ended prematurely: osmo-stp_10.42.42.5(pid=14849) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14849)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14863): Process ended prematurely: osmo-stp_10.42.42.5(pid=14863) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14863)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14874): Process ended prematurely: osmo-stp_10.42.42.5(pid=14874) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14874)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14888): Process ended prematurely: osmo-stp_10.42.42.5(pid=14888) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14888)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14899): Process ended prematurely: osmo-stp_10.42.42.5(pid=14899) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14899)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14914): Process ended prematurely: osmo-stp_10.42.42.5(pid=14914) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14914)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14925): Process ended prematurely: osmo-stp_10.42.42.5(pid=14925) [trial-2396↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14925)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14940): Process ended prematurely: osmo-stp_10.42.42.5(pid=14940) [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14940)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14951): Process ended prematurely: osmo-stp_10.42.42.5(pid=14951) [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14951)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14965): Process ended prematurely: osmo-stp_10.42.42.5(pid=14965) [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14965)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14979): Process ended prematurely: osmo-stp_10.42.42.5(pid=14979) [trial-2396↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14979)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14993): Process ended prematurely: osmo-stp_10.42.42.5(pid=14993) [trial-2396↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14993)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15004): Process ended prematurely: osmo-stp_10.42.42.5(pid=15004) [trial-2396↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15004)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15018): Process ended prematurely: osmo-stp_10.42.42.5(pid=15018) [trial-2396↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15018)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15029): Process ended prematurely: osmo-stp_10.42.42.5(pid=15029) [trial-2396↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15029)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=15047): Process ended prematurely: osmo-stp_10.42.42.5(pid=15047) [trial-2396↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15047)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=15059): Process ended prematurely: osmo-stp_10.42.42.5(pid=15059) [trial-2396↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15059)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=15080): Process ended prematurely: osmo-stp_10.42.42.5(pid=15080) [trial-2396↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15080)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15090): Process ended prematurely: osmo-stp_10.42.42.5(pid=15090) [trial-2396↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15090)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15101): Process ended prematurely: osmo-stp_10.42.42.5(pid=15101) [trial-2396↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15101)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=15118): Process ended prematurely: osmo-stp_10.42.42.5(pid=15118) [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15118)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=15130): Process ended prematurely: osmo-stp_10.42.42.5(pid=15130) [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15130)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=15148): Process ended prematurely: osmo-stp_10.42.42.5(pid=15148) [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15148)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15158): Process ended prematurely: osmo-stp_10.42.42.5(pid=15158) [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15158)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15168): Process ended prematurely: osmo-stp_10.42.42.5(pid=15168) [trial-2396↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15168)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=15185): Process ended prematurely: osmo-stp_10.42.42.5(pid=15185) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15185)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=15197): Process ended prematurely: osmo-stp_10.42.42.5(pid=15197) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15197)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=15215): Process ended prematurely: osmo-stp_10.42.42.5(pid=15215) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15215)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15225): Process ended prematurely: osmo-stp_10.42.42.5(pid=15225) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15225)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15235): Process ended prematurely: osmo-stp_10.42.42.5(pid=15235) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15235)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=15523): Process ended prematurely: osmo-stp_10.42.42.5(pid=15523) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15523)] FAIL: iperf3.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=15537): Process ended prematurely: osmo-stp_10.42.42.5(pid=15537) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15537)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=15556): Process ended prematurely: osmo-stp_10.42.42.5(pid=15556) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15556)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15566): Process ended prematurely: osmo-stp_10.42.42.5(pid=15566) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15566)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15576): Process ended prematurely: osmo-stp_10.42.42.5(pid=15576) [trial-2396↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15576)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=15597): Process ended prematurely: osmo-stp_10.42.42.5(pid=15597) [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15597)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=15609): Process ended prematurely: osmo-stp_10.42.42.5(pid=15609) [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15609)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=15627): Process ended prematurely: osmo-stp_10.42.42.5(pid=15627) [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15627)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15637): Process ended prematurely: osmo-stp_10.42.42.5(pid=15637) [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15637)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15652): Process ended prematurely: osmo-stp_10.42.42.5(pid=15652) [trial-2396↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15652)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15665): Process ended prematurely: osmo-stp_10.42.42.5(pid=15665) [trial-2396↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15665)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15678): Process ended prematurely: osmo-stp_10.42.42.5(pid=15678) [trial-2396↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15678)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=15686): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15686) [trial-2396↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15686)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15696): Process ended prematurely: osmo-stp_10.42.42.5(pid=15696) [trial-2396↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15696)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=15705): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15705) [trial-2396↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15705)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=15715): Process ended prematurely: osmo-stp_10.42.42.5(pid=15715) [trial-2396↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15715)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=15729): Process ended prematurely: osmo-stp_10.42.42.5(pid=15729) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15729)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15740): Process ended prematurely: osmo-stp_10.42.42.5(pid=15740) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15740)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15755): Process ended prematurely: osmo-stp_10.42.42.5(pid=15755) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15755)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15766): Process ended prematurely: osmo-stp_10.42.42.5(pid=15766) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15766)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15780): Process ended prematurely: osmo-stp_10.42.42.5(pid=15780) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15780)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15791): Process ended prematurely: osmo-stp_10.42.42.5(pid=15791) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15791)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15805): Process ended prematurely: osmo-stp_10.42.42.5(pid=15805) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15805)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15816): Process ended prematurely: osmo-stp_10.42.42.5(pid=15816) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15816)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15830): Process ended prematurely: osmo-stp_10.42.42.5(pid=15830) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15830)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15841): Process ended prematurely: osmo-stp_10.42.42.5(pid=15841) [trial-2396↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15841)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15855): Process ended prematurely: osmo-stp_10.42.42.5(pid=15855) [trial-2396↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15855)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15866): Process ended prematurely: osmo-stp_10.42.42.5(pid=15866) [trial-2396↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15866)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15881): Process ended prematurely: osmo-stp_10.42.42.5(pid=15881) [trial-2396↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15881)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15893): Process ended prematurely: osmo-stp_10.42.42.5(pid=15893) [trial-2396↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15893)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15907): Process ended prematurely: osmo-stp_10.42.42.5(pid=15907) [trial-2396↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15907)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15918): Process ended prematurely: osmo-stp_10.42.42.5(pid=15918) [trial-2396↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15918)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=15937): Process ended prematurely: osmo-stp_10.42.42.5(pid=15937) [trial-2396↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15937)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=15988): Process ended prematurely: osmo-stp_10.42.42.5(pid=15988) [trial-2396↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15988)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=16008): Process ended prematurely: osmo-stp_10.42.42.5(pid=16008) [trial-2396↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16008)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16018): Process ended prematurely: osmo-stp_10.42.42.5(pid=16018) [trial-2396↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16018)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16028): Process ended prematurely: osmo-stp_10.42.42.5(pid=16028) [trial-2396↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16028)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=16051): Process ended prematurely: osmo-stp_10.42.42.5(pid=16051) [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16051)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=16063): Process ended prematurely: osmo-stp_10.42.42.5(pid=16063) [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16063)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=16081): Process ended prematurely: osmo-stp_10.42.42.5(pid=16081) [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16081)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16091): Process ended prematurely: osmo-stp_10.42.42.5(pid=16091) [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16091)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16101): Process ended prematurely: osmo-stp_10.42.42.5(pid=16101) [trial-2396↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16101)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=16118): Process ended prematurely: osmo-stp_10.42.42.5(pid=16118) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16118)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=16130): Process ended prematurely: osmo-stp_10.42.42.5(pid=16130) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16130)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=16148): Process ended prematurely: osmo-stp_10.42.42.5(pid=16148) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16148)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16158): Process ended prematurely: osmo-stp_10.42.42.5(pid=16158) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16158)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16168): Process ended prematurely: osmo-stp_10.42.42.5(pid=16168) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16168)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=16185): Process ended prematurely: osmo-stp_10.42.42.5(pid=16185) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16185)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16198): Process ended prematurely: osmo-stp_10.42.42.5(pid=16198) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16198)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=16216): Process ended prematurely: osmo-stp_10.42.42.5(pid=16216) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16216)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16227): Process ended prematurely: osmo-stp_10.42.42.5(pid=16227) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16227)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16237): Process ended prematurely: osmo-stp_10.42.42.5(pid=16237) [trial-2396↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16237)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16250): Process ended prematurely: osmo-stp_10.42.42.5(pid=16250) [trial-2396↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16250)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16264): Process ended prematurely: osmo-stp_10.42.42.5(pid=16264) [trial-2396↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16264)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=16273): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16273) [trial-2396↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16273)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=16283): Process ended prematurely: osmo-stp_10.42.42.5(pid=16283) [trial-2396↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16283)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=16292): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16292) [trial-2396↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16292)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=16302): Process ended prematurely: osmo-stp_10.42.42.5(pid=16302) [trial-2396↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16302)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16316): Process ended prematurely: osmo-stp_10.42.42.5(pid=16316) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16316)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=16328): Process ended prematurely: osmo-stp_10.42.42.5(pid=16328) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16328)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16352): Process ended prematurely: osmo-stp_10.42.42.5(pid=16352) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16352)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16714): Process ended prematurely: osmo-stp_10.42.42.5(pid=16714) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16714)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16904): Process ended prematurely: osmo-stp_10.42.42.5(pid=16904) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16904)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=16915): Process ended prematurely: osmo-stp_10.42.42.5(pid=16915) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16915)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16929): Process ended prematurely: osmo-stp_10.42.42.5(pid=16929) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16929)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16940): Process ended prematurely: osmo-stp_10.42.42.5(pid=16940) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16940)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16954): Process ended prematurely: osmo-stp_10.42.42.5(pid=16954) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16954)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16965): Process ended prematurely: osmo-stp_10.42.42.5(pid=16965) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16965)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16979): Process ended prematurely: osmo-stp_10.42.42.5(pid=16979) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16979)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16990): Process ended prematurely: osmo-stp_10.42.42.5(pid=16990) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16990)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17004): Process ended prematurely: osmo-stp_10.42.42.5(pid=17004) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17004)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17015): Process ended prematurely: osmo-stp_10.42.42.5(pid=17015) [trial-2396↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17015)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17029): Process ended prematurely: osmo-stp_10.42.42.5(pid=17029) [trial-2396↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17029)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17040): Process ended prematurely: osmo-stp_10.42.42.5(pid=17040) [trial-2396↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17040)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=17058): Process ended prematurely: osmo-stp_10.42.42.5(pid=17058) [trial-2396↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17058)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17071): Process ended prematurely: osmo-stp_10.42.42.5(pid=17071) [trial-2396↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17071)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=17089): Process ended prematurely: osmo-stp_10.42.42.5(pid=17089) [trial-2396↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17089)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17099): Process ended prematurely: osmo-stp_10.42.42.5(pid=17099) [trial-2396↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17099)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17109): Process ended prematurely: osmo-stp_10.42.42.5(pid=17109) [trial-2396↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17109)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=17126): Process ended prematurely: osmo-stp_10.42.42.5(pid=17126) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17126)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=17138): Process ended prematurely: osmo-stp_10.42.42.5(pid=17138) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17138)] FAIL: iperf3m4.py (12.3 sec) Error: osmo-stp_10.42.42.5(pid=17428): Process ended prematurely: osmo-stp_10.42.42.5(pid=17428) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17428)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17439): Process ended prematurely: osmo-stp_10.42.42.5(pid=17439) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17439)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17449): Process ended prematurely: osmo-stp_10.42.42.5(pid=17449) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17449)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=17466): Process ended prematurely: osmo-stp_10.42.42.5(pid=17466) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17466)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=17478): Process ended prematurely: osmo-stp_10.42.42.5(pid=17478) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17478)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=17500): Process ended prematurely: osmo-stp_10.42.42.5(pid=17500) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17500)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17510): Process ended prematurely: osmo-stp_10.42.42.5(pid=17510) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17510)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17521): Process ended prematurely: osmo-stp_10.42.42.5(pid=17521) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17521)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=17539): Process ended prematurely: osmo-stp_10.42.42.5(pid=17539) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17539)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17552): Process ended prematurely: osmo-stp_10.42.42.5(pid=17552) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17552)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=17570): Process ended prematurely: osmo-stp_10.42.42.5(pid=17570) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17570)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17580): Process ended prematurely: osmo-stp_10.42.42.5(pid=17580) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17580)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17590): Process ended prematurely: osmo-stp_10.42.42.5(pid=17590) [trial-2396↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17590)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17603): Process ended prematurely: osmo-stp_10.42.42.5(pid=17603) [trial-2396↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17603)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17616): Process ended prematurely: osmo-stp_10.42.42.5(pid=17616) [trial-2396↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17616)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=17624): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17624) [trial-2396↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17624)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17634): Process ended prematurely: osmo-stp_10.42.42.5(pid=17634) [trial-2396↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17634)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=17643): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17643) [trial-2396↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17643)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17654): Process ended prematurely: osmo-stp_10.42.42.5(pid=17654) [trial-2396↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17654)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17668): Process ended prematurely: osmo-stp_10.42.42.5(pid=17668) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17668)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17679): Process ended prematurely: osmo-stp_10.42.42.5(pid=17679) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17679)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17693): Process ended prematurely: osmo-stp_10.42.42.5(pid=17693) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17693)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17704): Process ended prematurely: osmo-stp_10.42.42.5(pid=17704) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17704)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17718): Process ended prematurely: osmo-stp_10.42.42.5(pid=17718) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17718)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17729): Process ended prematurely: osmo-stp_10.42.42.5(pid=17729) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17729)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=17744): Process ended prematurely: osmo-stp_10.42.42.5(pid=17744) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17744)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17755): Process ended prematurely: osmo-stp_10.42.42.5(pid=17755) [trial-2396↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17755)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17769): Process ended prematurely: osmo-stp_10.42.42.5(pid=17769) [trial-2396↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17769)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17780): Process ended prematurely: osmo-stp_10.42.42.5(pid=17780) [trial-2396↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17780)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17794): Process ended prematurely: osmo-stp_10.42.42.5(pid=17794) [trial-2396↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17794)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17805): Process ended prematurely: osmo-stp_10.42.42.5(pid=17805) [trial-2396↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17805)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=17823): Process ended prematurely: osmo-stp_10.42.42.5(pid=17823) [trial-2396↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17823)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=17838): Process ended prematurely: osmo-stp_10.42.42.5(pid=17838) [trial-2396↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17838)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=17857): Process ended prematurely: osmo-stp_10.42.42.5(pid=17857) [trial-2396↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17857)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17867): Process ended prematurely: osmo-stp_10.42.42.5(pid=17867) [trial-2396↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17867)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17877): Process ended prematurely: osmo-stp_10.42.42.5(pid=17877) [trial-2396↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17877)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=17897): Process ended prematurely: osmo-stp_10.42.42.5(pid=17897) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17897)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=17909): Process ended prematurely: osmo-stp_10.42.42.5(pid=17909) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17909)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=17927): Process ended prematurely: osmo-stp_10.42.42.5(pid=17927) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17927)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17937): Process ended prematurely: osmo-stp_10.42.42.5(pid=17937) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17937)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17947): Process ended prematurely: osmo-stp_10.42.42.5(pid=17947) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17947)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=17964): Process ended prematurely: osmo-stp_10.42.42.5(pid=17964) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17964)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=17979): Process ended prematurely: osmo-stp_10.42.42.5(pid=17979) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17979)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=17997): Process ended prematurely: osmo-stp_10.42.42.5(pid=17997) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17997)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18007): Process ended prematurely: osmo-stp_10.42.42.5(pid=18007) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18007)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18017): Process ended prematurely: osmo-stp_10.42.42.5(pid=18017) [trial-2396↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18017)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18030): Process ended prematurely: osmo-stp_10.42.42.5(pid=18030) [trial-2396↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18030)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18043): Process ended prematurely: osmo-stp_10.42.42.5(pid=18043) [trial-2396↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18043)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=18052): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18052) [trial-2396↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18052)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18063): Process ended prematurely: osmo-stp_10.42.42.5(pid=18063) [trial-2396↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18063)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18078): Process ended prematurely: osmo-stp_10.42.42.5(pid=18078) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18078)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18089): Process ended prematurely: osmo-stp_10.42.42.5(pid=18089) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18089)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18103): Process ended prematurely: osmo-stp_10.42.42.5(pid=18103) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18103)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18114): Process ended prematurely: osmo-stp_10.42.42.5(pid=18114) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18114)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=18129): Process ended prematurely: osmo-stp_10.42.42.5(pid=18129) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18129)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18140): Process ended prematurely: osmo-stp_10.42.42.5(pid=18140) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18140)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18154): Process ended prematurely: osmo-stp_10.42.42.5(pid=18154) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18154)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18165): Process ended prematurely: osmo-stp_10.42.42.5(pid=18165) [trial-2396↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18165)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18179): Process ended prematurely: osmo-stp_10.42.42.5(pid=18179) [trial-2396↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18179)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18190): Process ended prematurely: osmo-stp_10.42.42.5(pid=18190) [trial-2396↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18190)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18208): Process ended prematurely: osmo-stp_10.42.42.5(pid=18208) [trial-2396↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18208)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=18219): Process ended prematurely: osmo-stp_10.42.42.5(pid=18219) [trial-2396↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18219)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18235): Process ended prematurely: osmo-stp_10.42.42.5(pid=18235) [trial-2396↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18235)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18246): Process ended prematurely: osmo-stp_10.42.42.5(pid=18246) [trial-2396↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18246)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=18265): Process ended prematurely: osmo-stp_10.42.42.5(pid=18265) [trial-2396↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18265)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=18277): Process ended prematurely: osmo-stp_10.42.42.5(pid=18277) [trial-2396↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18277)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=18295): Process ended prematurely: osmo-stp_10.42.42.5(pid=18295) [trial-2396↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18295)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18305): Process ended prematurely: osmo-stp_10.42.42.5(pid=18305) [trial-2396↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18305)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18315): Process ended prematurely: osmo-stp_10.42.42.5(pid=18315) [trial-2396↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18315)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=18332): Process ended prematurely: osmo-stp_10.42.42.5(pid=18332) [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18332)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=18344): Process ended prematurely: osmo-stp_10.42.42.5(pid=18344) [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18344)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=18363): Process ended prematurely: osmo-stp_10.42.42.5(pid=18363) [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18363)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18374): Process ended prematurely: osmo-stp_10.42.42.5(pid=18374) [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18374)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18384): Process ended prematurely: osmo-stp_10.42.42.5(pid=18384) [trial-2396↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18384)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=18401): Process ended prematurely: osmo-stp_10.42.42.5(pid=18401) [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18401)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=18413): Process ended prematurely: osmo-stp_10.42.42.5(pid=18413) [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18413)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=18431): Process ended prematurely: osmo-stp_10.42.42.5(pid=18431) [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18431)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18441): Process ended prematurely: osmo-stp_10.42.42.5(pid=18441) [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18441)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18451): Process ended prematurely: osmo-stp_10.42.42.5(pid=18451) [trial-2396↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18451)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=18502): Process ended prematurely: osmo-stp_10.42.42.5(pid=18502) [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18502)] FAIL: iperf3.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=18752): Process ended prematurely: osmo-stp_10.42.42.5(pid=18752) [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18752)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=18771): Process ended prematurely: osmo-stp_10.42.42.5(pid=18771) [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18771)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18781): Process ended prematurely: osmo-stp_10.42.42.5(pid=18781) [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18781)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18791): Process ended prematurely: osmo-stp_10.42.42.5(pid=18791) [trial-2396↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18791)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18807): Process ended prematurely: osmo-stp_10.42.42.5(pid=18807) [trial-2396↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18807)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=18817): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18817) [trial-2396↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18817)] FAIL: esme_connect_policy_closed.py (1.9 sec) Error: osmo-nitb_10.42.42.2(pid=18819): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18819) [trial-2396↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18819)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=18821): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18821) [trial-2396↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18821)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=18823): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18823) [trial-2396↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18823)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.4 sec) Error: osmo-hlr_10.42.42.2(pid=18832): Process ended prematurely: osmo-hlr_10.42.42.2(pid=18832) [trial-2396↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18832)] FAIL: esme_connect_policy_closed.py (6.3 sec) Error: osmo-hlr_10.42.42.2(pid=18843): Process ended prematurely: osmo-hlr_10.42.42.2(pid=18843) [trial-2396↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18843)] FAIL: esme_ms_sms_storeforward.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18855): Process ended prematurely: osmo-stp_10.42.42.5(pid=18855) [trial-2396↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18855)] FAIL: esme_ms_sms_transaction.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18866): Process ended prematurely: osmo-stp_10.42.42.5(pid=18866) [trial-2396↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18866)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18883): Process ended prematurely: osmo-stp_10.42.42.5(pid=18883) [trial-2396↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18883)] FAIL: register_a5_0_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18894): Process ended prematurely: osmo-stp_10.42.42.5(pid=18894) [trial-2396↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18894)] FAIL: register_a5_1_authreq.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18905): Process ended prematurely: osmo-stp_10.42.42.5(pid=18905) [trial-2396↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18905)] FAIL: register_a5_3_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18916): Process ended prematurely: osmo-stp_10.42.42.5(pid=18916) [trial-2396↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18916)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.9 sec) Error: srsepc(pid=18936): Process ended prematurely: srsepc(pid=18936) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18936)] FAIL: iperf3_bidir.py (19.1 sec) Error: srsepc(pid=18952): Process ended prematurely: srsepc(pid=18952) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18952)] FAIL: iperf3_dl.py (18.8 sec) Error: srsepc(pid=18968): Process ended prematurely: srsepc(pid=18968) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18968)] FAIL: iperf3_ul.py (18.7 sec) Error: srsepc(pid=18984): Process ended prematurely: srsepc(pid=18984) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18984)] FAIL: ping.py (18.4 sec) Error: srsepc(pid=19000): Process ended prematurely: srsepc(pid=19000) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19000)] FAIL: rrc_idle_mo_ping.py (18.0 sec) Error: srsepc(pid=19016): Process ended prematurely: srsepc(pid=19016) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19016)] FAIL: rrc_idle_mt_ping.py (18.1 sec) Error: srsepc(pid=19032): Process ended prematurely: srsepc(pid=19032) [trial-2396↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19032)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19045): Process ended prematurely: osmo-stp_10.42.42.5(pid=19045) [trial-2396↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19045)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19060): Process ended prematurely: osmo-stp_10.42.42.5(pid=19060) [trial-2396↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19060)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19075): Process ended prematurely: osmo-stp_10.42.42.5(pid=19075) [trial-2396↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19075)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19089): Process ended prematurely: osmo-stp_10.42.42.5(pid=19089) [trial-2396↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19089)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19103): Process ended prematurely: osmo-stp_10.42.42.5(pid=19103) [trial-2396↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19103)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19118): Process ended prematurely: osmo-stp_10.42.42.5(pid=19118) [trial-2396↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19118)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19132): Process ended prematurely: osmo-stp_10.42.42.5(pid=19132) [trial-2396↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19132)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19150): Process ended prematurely: osmo-stp_10.42.42.5(pid=19150) [trial-2396↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19150)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19164): Process ended prematurely: osmo-stp_10.42.42.5(pid=19164) [trial-2396↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19164)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19179): Process ended prematurely: osmo-stp_10.42.42.5(pid=19179) [trial-2396↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19179)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19193): Process ended prematurely: osmo-stp_10.42.42.5(pid=19193) [trial-2396↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19193)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19210): Process ended prematurely: osmo-stp_10.42.42.5(pid=19210) [trial-2396↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19210)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19224): Process ended prematurely: osmo-stp_10.42.42.5(pid=19224) [trial-2396↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19224)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19238): Process ended prematurely: osmo-stp_10.42.42.5(pid=19238) [trial-2396↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19238)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19252): Process ended prematurely: osmo-stp_10.42.42.5(pid=19252) [trial-2396↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19252)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19266): Process ended prematurely: osmo-stp_10.42.42.5(pid=19266) [trial-2396↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19266)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19280): Process ended prematurely: osmo-stp_10.42.42.5(pid=19280) [trial-2396↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19280)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19294): Process ended prematurely: osmo-stp_10.42.42.5(pid=19294) [trial-2396↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19294)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19308): Process ended prematurely: osmo-stp_10.42.42.5(pid=19308) [trial-2396↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19308)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19322): Process ended prematurely: osmo-stp_10.42.42.5(pid=19322) [trial-2396↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19322)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19336): Process ended prematurely: osmo-stp_10.42.42.5(pid=19336) [trial-2396↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19336)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19350): Process ended prematurely: osmo-stp_10.42.42.5(pid=19350) [trial-2396↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19350)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19365): Process ended prematurely: osmo-stp_10.42.42.5(pid=19365) [trial-2396↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19365)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19379): Process ended prematurely: osmo-stp_10.42.42.5(pid=19379) [trial-2396↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19379)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19393): Process ended prematurely: osmo-stp_10.42.42.5(pid=19393) [trial-2396↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19393)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19407): Process ended prematurely: osmo-stp_10.42.42.5(pid=19407) [trial-2396↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19407)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19421): Process ended prematurely: osmo-stp_10.42.42.5(pid=19421) [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19421)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19435): Process ended prematurely: osmo-stp_10.42.42.5(pid=19435) [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19435)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19449): Process ended prematurely: osmo-stp_10.42.42.5(pid=19449) [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19449)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19463): Process ended prematurely: osmo-stp_10.42.42.5(pid=19463) [trial-2396↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19463)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19479): Process ended prematurely: osmo-stp_10.42.42.5(pid=19479) [trial-2396↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19479)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19494): Process ended prematurely: osmo-stp_10.42.42.5(pid=19494) [trial-2396↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19494)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19509): Process ended prematurely: osmo-stp_10.42.42.5(pid=19509) [trial-2396↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19509)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19526): Process ended prematurely: osmo-stp_10.42.42.5(pid=19526) [trial-2396↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19526)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19540): Process ended prematurely: osmo-stp_10.42.42.5(pid=19540) [trial-2396↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19540)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=19574): Process ended prematurely: osmo-stp_10.42.42.5(pid=19574) [trial-2396↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19574)] + rm -rf trial-2396/inst + cd trial-2396 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-13 23:11:40 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396-run.tgz run.2022-12-13_23-11-51 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2396-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17682.tgz osmo-bts-oc2g.build-5538.tgz osmo-bts-sysmo.build-8042.tgz osmo-bts.build-7511.tgz osmo-ggsn.build-6692.tgz osmo-hlr.build-8716.tgz osmo-hnbgw.build-2989.tgz osmo-mgw.build-8961.tgz osmo-msc.build-29309.tgz osmo-nitb.build-12992.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30095.tgz osmo-stp.build-9257.tgz osmo-trx.build-4684.tgz osmocom-bb.build-4712.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE